-- Logs begin at Mon 2022-10-03 15:19:55 UTC, end at Mon 2022-10-03 16:27:55 UTC. -- Oct 03 15:49:30.140550 dv-cinder-844563-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 03 15:49:30.147802 dv-cinder-844563-13-smb devstack@keystone.service[81549]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 15:49:30 2022] *** Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: nodename: dv-cinder-844563-13-smb Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: machine: x86_64 Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: clock source: unix Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: pcre jit disabled Oct 03 15:49:30.150938 dv-cinder-844563-13-smb devstack@keystone.service[81549]: detected number of CPU cores: 4 Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: current working directory: / Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: detected binary path: /usr/bin/uwsgi-core Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: your processes number limit is 47680 Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: your memory page size is 4096 bytes Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: detected max file descriptor number: 2048 Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: lock engine: pthread robust mutexes Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: thunder lock: enabled Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 03 15:49:30.154497 dv-cinder-844563-13-smb devstack@keystone.service[81549]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 15:49:30.191453 dv-cinder-844563-13-smb devstack@keystone.service[81549]: Python main interpreter initialized at 0x55e7d84239c0 Oct 03 15:49:30.191453 dv-cinder-844563-13-smb devstack@keystone.service[81549]: python threads support enabled Oct 03 15:49:30.191453 dv-cinder-844563-13-smb devstack@keystone.service[81549]: your server socket listen backlog is limited to 100 connections Oct 03 15:49:30.191453 dv-cinder-844563-13-smb devstack@keystone.service[81549]: your mercy for graceful operations on workers is 90 seconds Oct 03 15:49:30.191834 dv-cinder-844563-13-smb devstack@keystone.service[81549]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 15:49:30.191911 dv-cinder-844563-13-smb devstack@keystone.service[81549]: *** Operational MODE: preforking *** Oct 03 15:49:30.192167 dv-cinder-844563-13-smb devstack@keystone.service[81549]: *** uWSGI is running in multiple interpreter mode *** Oct 03 15:49:30.192167 dv-cinder-844563-13-smb devstack@keystone.service[81549]: spawned uWSGI master process (pid: 81549) Oct 03 15:49:30.192372 dv-cinder-844563-13-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 03 15:49:30.193469 dv-cinder-844563-13-smb devstack@keystone.service[81549]: spawned uWSGI worker 1 (pid: 81563, cores: 1) Oct 03 15:49:30.193469 dv-cinder-844563-13-smb devstack@keystone.service[81549]: spawned uWSGI worker 2 (pid: 81564, cores: 1) Oct 03 15:49:30.193469 dv-cinder-844563-13-smb devstack@keystone.service[81549]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 15:49:34.542702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:49:34.542702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: from cryptography.utils import int_from_bytes Oct 03 15:49:34.543489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:49:34.543489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: from cryptography.utils import int_from_bytes Oct 03 15:49:34.546368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:49:34.546368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: from cryptography.utils import int_from_bytes Oct 03 15:49:34.546815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 15:49:34.546815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: from cryptography.utils import int_from_bytes Oct 03 15:49:34.592873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 15:49:34.593067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 15:49:34.593266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] command line args: [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 15:49:34.593537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 15:49:34.593721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ================================================================================ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 15:49:34.594009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] admin_token = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.594260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_dir = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.594451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.594534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 15:49:34.594638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_source = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.594714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 15:49:34.594820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] debug = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.594903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] command line args: [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 15:49:34.595023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.595302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 15:49:34.595302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ================================================================================ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 15:49:34.595418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.595553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] admin_token = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.595642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.595804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.595913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config_dir = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config_source = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] debug = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_config_append = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.596982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_dir = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_config_append = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.597958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_dir = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.598931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.599940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.600047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.600193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.600324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.600450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.600658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.600787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.600907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] publish_errors = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.601961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.602075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.602299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] standard_threads = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.602418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.602582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.602702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] publish_errors = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.602836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.602956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.603069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.603186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.603297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_journal = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.603407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.603524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_json = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.604331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.604453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_stderr = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.604453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_syslog = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.604792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.604792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] standard_threads = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.605017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.605139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.605258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.605370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.605481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.605592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.605592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_journal = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.605835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.605958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_json = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.606071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.606188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_stderr = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.606301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.606412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_syslog = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.606596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.606710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 15:49:34.606822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.606941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.607984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.608904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.609998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.610971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.611889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612300 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.612976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.613994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.614915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.615935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616155 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.616952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.617932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.618995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.619115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.619264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.619497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.619617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.619730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.619842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.619963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620434 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.620893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.621939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.622973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.623959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624765 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.624877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.625891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.626941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.627151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.627272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.627386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.627502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.627615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.627727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.627887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.628952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.629995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.external = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630685 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.630919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.password = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631411 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.token = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.631892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.external = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.632933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.password = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.token = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.633918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.634891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.635946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.636984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.637998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.638926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639265 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.639953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.640994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.641961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.642883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.643906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.644912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.645951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.646995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.647923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.648945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.649899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.650013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.650126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.650238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.650351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.650996 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.651917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.652943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.653944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.654959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.655995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.656917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.657933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.658963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.659877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.660966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.661907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.662946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.663980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.664991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.665959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.666137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.666741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.666869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.666985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667758 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.667990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.668915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.669941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.670975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671663 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.671890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.672932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.673981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.674910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.675957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.676985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.677947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.678839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 15:49:34.679969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.679969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.680190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.680404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.680649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.680891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.681144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.681388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.681658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.681995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.682256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.682500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.682755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.682994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.683244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.683488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 15:49:34.683665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 15:49:34.708786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.709017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.709246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.712871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.713733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.713998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.718207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.722388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.746785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.747019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.748947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.749192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.800850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.801065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.850013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.850251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.851140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:34.851385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.006685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.006912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007327 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007765 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.007985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.008205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.030844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.031965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.032046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.032181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.032262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.032400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.043943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.044160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.056470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.056704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.057437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.057980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.058881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 15:49:35.075035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.075245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 15:49:35.075329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.075488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 15:49:35.075570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.075773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 15:49:35.075856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.076047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 15:49:35.076133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.076309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.076391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.076575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.076656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.076840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.076919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.077105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.086634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.086923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.087005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.087200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.087281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.087527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.087624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.087799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.094712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.094954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.097589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.097905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.097993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.098195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.098278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.098484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.098579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.098770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.098853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.099940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.100137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.100218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.100408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.100488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.100700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.123988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.124439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.125442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.125728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.125940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.126233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.130381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.130666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.130888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.130970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.131179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.131469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.137428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.137718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.137879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.138176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.143324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.143625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.143844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.143926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.144149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.144230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.144445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.144527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.144729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.144810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.145002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.145097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.145273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.145355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.145547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.145849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.161089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.161371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.161945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.162243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.165169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.166786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.168903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.169204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.170065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.170370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.173347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.174600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.176457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.177780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.179617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.179919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.180208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.180496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.180778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.181008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.181091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.181316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.181611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.181951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.182250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.182548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.196604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.196894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.197166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.197488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.198442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.198741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.199016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.199285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.204399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.206210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.206407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.207735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.207952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.208033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.209478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.209783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.210852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.211138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.211424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.211719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.212116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.212571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.212865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.213745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.214067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.214463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.223799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.224094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.224478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.224645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.225035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.225330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.225602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.225691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.225933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.226225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.226514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.226902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.227191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.227486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.241585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.243459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.244514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.246518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.247474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.249640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.249735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.250713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.250898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.250980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.251390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.252494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.252781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.253185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.257694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.259160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.259583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.261277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.262121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.262521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.262812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.263096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.264191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.264597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.264894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.265181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.270869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.271164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.271446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.273026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.273327 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.273620 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.278970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.279257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.279542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.279824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.280102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.280376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.280655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.280937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.281220 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.281394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 15:49:35.281507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.281689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.281794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.282007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.282091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.282292 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.282375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.282571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.282657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.282849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.283136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.283431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.283709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.283996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.284276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.284560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.284833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.285150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 15:49:35.316992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e7d84239c0 pid: 81564 (default app) Oct 03 15:49:35.320007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e7d84239c0 pid: 81563 (default app) Oct 03 15:49:35.320237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277241fb-634f-4a28-b63a-aedc018c3ffe None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:35.320524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277241fb-634f-4a28-b63a-aedc018c3ffe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:35.320797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277241fb-634f-4a28-b63a-aedc018c3ffe None None] PATH_INFO: `/v3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:35.324987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Mon Oct 3 15:49:35 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:42.940454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236bff6-f235-4d7a-9b92-faf1e7147f6d None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:42.940945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236bff6-f235-4d7a-9b92-faf1e7147f6d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:42.941015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236bff6-f235-4d7a-9b92-faf1e7147f6d None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:42.945306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:49:42.953135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:42.956726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:42.957007 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:43.028518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: INFO dbcounter [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] Registered counter for database keystone Oct 03 15:49:43.048086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG oslo_db.sqlalchemy.engines [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:49:43.054427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writer thread running {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:49:43.237830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG passlib.handlers.bcrypt [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81564) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 15:49:43.238208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG passlib.handlers.bcrypt [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81564) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 15:49:43.297467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:43.299043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:43.427345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 03 15:49:43.893813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236bff6-f235-4d7a-9b92-faf1e7147f6d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:43.964175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: INFO dbcounter [None req-1236bff6-f235-4d7a-9b92-faf1e7147f6d None None] Registered counter for database keystone Oct 03 15:49:43.985543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG oslo_db.sqlalchemy.engines [None req-1236bff6-f235-4d7a-9b92-faf1e7147f6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 15:49:43.991788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writer thread running {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 15:49:44.111719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236bff6-f235-4d7a-9b92-faf1e7147f6d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:44.115963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5837f99-bfa9-4df5-b3b7-76ab9c269e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:44.116588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5837f99-bfa9-4df5-b3b7-76ab9c269e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:44.116868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5837f99-bfa9-4df5-b3b7-76ab9c269e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:44.117137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5837f99-bfa9-4df5-b3b7-76ab9c269e92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:44.125432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5837f99-bfa9-4df5-b3b7-76ab9c269e92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:44.178459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a5837f99-bfa9-4df5-b3b7-76ab9c269e92 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 15:49:44.178800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5837f99-bfa9-4df5-b3b7-76ab9c269e92 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:44.188935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Oct 3 15:49:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 15:49:44.195245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:44.213143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621424-b51b-4fa6-8656-4115a6becb0d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:44.217751 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3e253-bb9a-46ef-a9a5-0adb38433d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:44.218881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3e253-bb9a-46ef-a9a5-0adb38433d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:44.219166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3e253-bb9a-46ef-a9a5-0adb38433d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:44.228830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3e253-bb9a-46ef-a9a5-0adb38433d28 admin admin] PATH_INFO: `/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:44.228830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3e253-bb9a-46ef-a9a5-0adb38433d28 admin admin] RBAC: Authorizing `identity:get_project(project_id=070db3b7d7b04a4ba14f4a1d107620fd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:44.275399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a5a3e253-bb9a-46ef-a9a5-0adb38433d28 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 15:49:44.275725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3e253-bb9a-46ef-a9a5-0adb38433d28 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:44.280354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Mon Oct 3 15:49:44 2022] GET /identity/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:46.466447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b725-730d-440b-8219-04d7e65f1a3c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:46.467017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b725-730d-440b-8219-04d7e65f1a3c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:46.467017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b725-730d-440b-8219-04d7e65f1a3c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:46.471049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:46.476502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247ec07-7c1f-4300-9f36-4f7de9542865 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:46.476893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247ec07-7c1f-4300-9f36-4f7de9542865 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:46.477052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247ec07-7c1f-4300-9f36-4f7de9542865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:46.497683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0247ec07-7c1f-4300-9f36-4f7de9542865 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:46.499212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0247ec07-7c1f-4300-9f36-4f7de9542865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:46.506984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 03 15:49:46.776404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0b725-730d-440b-8219-04d7e65f1a3c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:46.788523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0b725-730d-440b-8219-04d7e65f1a3c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:46.792734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aefa07-0b4c-452a-a032-aa399fc0f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:46.793328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefa07-0b4c-452a-a032-aa399fc0f270 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:46.793612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefa07-0b4c-452a-a032-aa399fc0f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:46.793927 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefa07-0b4c-452a-a032-aa399fc0f270 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:46.801441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aefa07-0b4c-452a-a032-aa399fc0f270 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:46.803259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aefa07-0b4c-452a-a032-aa399fc0f270 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:46.812348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Oct 3 15:49:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 15:49:46.817586 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247ec07-7c1f-4300-9f36-4f7de9542865 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:46.827023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247ec07-7c1f-4300-9f36-4f7de9542865 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:46.831524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888b3d4-90fc-45b7-ab87-aeb60f54d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:46.832139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b3d4-90fc-45b7-ab87-aeb60f54d2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:46.832419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b3d4-90fc-45b7-ab87-aeb60f54d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:46.832690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888b3d4-90fc-45b7-ab87-aeb60f54d2d4 admin admin] PATH_INFO: `/v3/users/1309f51714bc425caa70be3d6c622b5e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:46.834052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888b3d4-90fc-45b7-ab87-aeb60f54d2d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1309f51714bc425caa70be3d6c622b5e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:46.835867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888b3d4-90fc-45b7-ab87-aeb60f54d2d4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:46.837364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Mon Oct 3 15:49:46 2022] GET /identity/v3/users/1309f51714bc425caa70be3d6c622b5e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:49.030854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfb48c-a81a-4fdc-96e0-c34f14b4f8e9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.031382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfb48c-a81a-4fdc-96e0-c34f14b4f8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.031382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfb48c-a81a-4fdc-96e0-c34f14b4f8e9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.032629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:49.037655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfcbae-6d36-43f9-b1c3-cf82d32c325f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.038099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfcbae-6d36-43f9-b1c3-cf82d32c325f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.038243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfcbae-6d36-43f9-b1c3-cf82d32c325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.058479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-14dfcbae-6d36-43f9-b1c3-cf82d32c325f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:49.059661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-14dfcbae-6d36-43f9-b1c3-cf82d32c325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:49.095135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911a5a4-8138-47ad-bb08-08520bff0882 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.095422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911a5a4-8138-47ad-bb08-08520bff0882 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.095696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911a5a4-8138-47ad-bb08-08520bff0882 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.097010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:49:49.102105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.102387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.102661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.142281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:49:49.145205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG passlib.handlers.bcrypt [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81563) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 15:49:49.145599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG passlib.handlers.bcrypt [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81563) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 15:49:49.194819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:49.196385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:49.300726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:49:49.411139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfcbae-6d36-43f9-b1c3-cf82d32c325f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:49.436735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:49.516407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfcbae-6d36-43f9-b1c3-cf82d32c325f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:49.549975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:49.550610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.550937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.551165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.561930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:49:49.570664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:49:49.571754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:49:49.573030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:49:49.573739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:49.573850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:49:49.577357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:49.671244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:49.685613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6259746-9d91-4c26-9542-eff49a868bc4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:49.688573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:49.691893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a07a6-6e42-4b6d-948e-7fb834c8c656 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:49.724124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:49.724986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.725315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.725793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.731367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:49.731983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.732267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.732895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.733207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:49:49.733513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:49.734957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:49.747368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:49:49.753111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:49.809842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:49.812408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:49.865459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad869d-623a-4198-a5d2-e3256a457430 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:49.907394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:49.908042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:49.908324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:49.908609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] PATH_INFO: `/v3/users/1309f51714bc425caa70be3d6c622b5e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:49.909820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] RBAC: Authorizing `identity:get_user(user_id=1309f51714bc425caa70be3d6c622b5e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:49.911979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:49.913724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 9/16] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:49:49 2022] GET /identity/v3/users/1309f51714bc425caa70be3d6c622b5e => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:49:49.919690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:49.936195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:49.942489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 15:49:49.948812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:49.952980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:50.047719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b458d-4357-446e-8345-4ca8f15182d0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:50.061703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff295e-4b93-4d41-82a6-4d2900935542 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:50.094423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:50.095063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:50.095340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:50.095611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:50.096907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:50.098434 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:50.100180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 10/18] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:49:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:49:50.105656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:50.106616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:50.106975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:50.107143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:50.108192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:50.128726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:50.130800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:49:50.154192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:49:50.155201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:49:50.156222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:49:50.156222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:49:50.156222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:49:50.156222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 9/19] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:49:50.162105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:50.211619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:50.229263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:50.234028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c950b-df54-4a9b-80d4-781101a4bf5a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:50.285858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f077e9-8a71-4739-a6d4-17cec01bc963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:50.286479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f077e9-8a71-4739-a6d4-17cec01bc963 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:50.286769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f077e9-8a71-4739-a6d4-17cec01bc963 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:50.287048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f077e9-8a71-4739-a6d4-17cec01bc963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:50.287788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f077e9-8a71-4739-a6d4-17cec01bc963 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.domain.id=default, user.id=1309f51714bc425caa70be3d6c622b5e) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:49:50.288102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f077e9-8a71-4739-a6d4-17cec01bc963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:50.289558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f077e9-8a71-4739-a6d4-17cec01bc963 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:50.290240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88a78-d321-457d-9dcc-76896dc0ea99 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:50.297851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Oct 3 15:49:50 2022] GET /identity/v3/role_assignments?user.id=1309f51714bc425caa70be3d6c622b5e&scope.domain.id=default&role.id=722cda8b508d40678af249ff70cb0751 => generated 233 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:49:50.332118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266047d-59b9-4e5d-a99e-9b545b6699ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:50.332642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266047d-59b9-4e5d-a99e-9b545b6699ad None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:50.332996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266047d-59b9-4e5d-a99e-9b545b6699ad None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:50.333275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266047d-59b9-4e5d-a99e-9b545b6699ad None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:50.333969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266047d-59b9-4e5d-a99e-9b545b6699ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:49:50.334279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266047d-59b9-4e5d-a99e-9b545b6699ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:50.336002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266047d-59b9-4e5d-a99e-9b545b6699ad None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:50.359084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:49:52.986340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ecfb0-1261-4287-9301-3b563ab0b7d9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:52.986842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ecfb0-1261-4287-9301-3b563ab0b7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:52.986842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ecfb0-1261-4287-9301-3b563ab0b7d9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:52.988116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:52.993353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c009cc-0c9f-42b6-bb42-6a62b1de17c3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:52.994833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c009cc-0c9f-42b6-bb42-6a62b1de17c3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:52.995458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c009cc-0c9f-42b6-bb42-6a62b1de17c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.022942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f6c009cc-0c9f-42b6-bb42-6a62b1de17c3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:53.024606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f6c009cc-0c9f-42b6-bb42-6a62b1de17c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:53.063615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ce4e-b16f-4ee0-a913-da94e987b6fe None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:53.064244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ce4e-b16f-4ee0-a913-da94e987b6fe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:53.064740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541ce4e-b16f-4ee0-a913-da94e987b6fe None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.066728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 13/23] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:53.072730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ebe8-2a1d-40f3-9338-ebb105ff80bd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:53.073398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ebe8-2a1d-40f3-9338-ebb105ff80bd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:53.074065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ebe8-2a1d-40f3-9338-ebb105ff80bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.122766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f641ebe8-2a1d-40f3-9338-ebb105ff80bd None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:53.123296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:49:53.124722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f641ebe8-2a1d-40f3-9338-ebb105ff80bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:53.227092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:49:53.254546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3e5aa-ab76-4092-be0a-1fd0ceeda275 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:53.255128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3e5aa-ab76-4092-be0a-1fd0ceeda275 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:53.255611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3e5aa-ab76-4092-be0a-1fd0ceeda275 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.257211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 12/26] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:53.276833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf0c2-62d0-41f5-b258-7b9a807f6c6f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:53.277126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf0c2-62d0-41f5-b258-7b9a807f6c6f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:53.277405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf0c2-62d0-41f5-b258-7b9a807f6c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.302966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9afcf0c2-62d0-41f5-b258-7b9a807f6c6f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:53.304151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9afcf0c2-62d0-41f5-b258-7b9a807f6c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:53.401018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:49:53.610767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3e5aa-ab76-4092-be0a-1fd0ceeda275 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:53.668924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:53.682655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf0c2-62d0-41f5-b258-7b9a807f6c6f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:53.686793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:53.779664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3e5aa-ab76-4092-be0a-1fd0ceeda275 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:53.841041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcf0c2-62d0-41f5-b258-7b9a807f6c6f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:53.852442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb2078-8377-4190-863f-c99f777f0be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:53.853418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb2078-8377-4190-863f-c99f777f0be5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:53.854420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb2078-8377-4190-863f-c99f777f0be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:53.854891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb2078-8377-4190-863f-c99f777f0be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.866020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb2078-8377-4190-863f-c99f777f0be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:53.867755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb2078-8377-4190-863f-c99f777f0be5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:53.882108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:53.882744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:53.883027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:53.883303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-76eb2078-8377-4190-863f-c99f777f0be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:49:53.885925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:49:53.886788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:49:53.887683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:49:53.887683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:49:53.887683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:49:53.889741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 13/28] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:49:53.891406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386f7a-9e1c-470f-99ed-29c95f685975 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:53.891839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386f7a-9e1c-470f-99ed-29c95f685975 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:53.892267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52386f7a-9e1c-470f-99ed-29c95f685975 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:53.893631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 14/29] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:53.897794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386f7a-9e1c-470f-99ed-29c95f685975 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:53.897923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:49:53.900981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:49:53.902433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:49:53.903224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:49:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:49:53.908686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:53.979566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:54.022753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:54.024748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95073b6-fddc-4a40-bf3a-dd63851904af None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:54.028155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52386f7a-9e1c-470f-99ed-29c95f685975 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:54.069366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f49cc-e982-4ce6-a51c-7190044c8b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:54.070206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f49cc-e982-4ce6-a51c-7190044c8b01 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.070580 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f49cc-e982-4ce6-a51c-7190044c8b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.070964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f49cc-e982-4ce6-a51c-7190044c8b01 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.071713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f49cc-e982-4ce6-a51c-7190044c8b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:49:54.071930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:54.072041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f49cc-e982-4ce6-a51c-7190044c8b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:54.073221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.073500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.073786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.074532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:54.075388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f49cc-e982-4ce6-a51c-7190044c8b01 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:54.075905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:54.096236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 17/31] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:54.097486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016fe2-3a5d-4d2d-b3f5-c93307fdcf7a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.097788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016fe2-3a5d-4d2d-b3f5-c93307fdcf7a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.098078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016fe2-3a5d-4d2d-b3f5-c93307fdcf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.117045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e9016fe2-3a5d-4d2d-b3f5-c93307fdcf7a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:54.118193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e9016fe2-3a5d-4d2d-b3f5-c93307fdcf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:54.205691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 18/32] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:49:54.207315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016fe2-3a5d-4d2d-b3f5-c93307fdcf7a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:54.268353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 15/33] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Oct 3 15:49:53 2022] POST /identity/v3/roles => generated 219 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:49:54.269225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:54.269330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:54.332121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016fe2-3a5d-4d2d-b3f5-c93307fdcf7a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:54.384907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:54.386017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.386495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.386977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.387916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:49:54.388410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:54.390154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:54.401352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 19/34] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:49:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:54.410430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:54.546575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad6f85-234d-473f-9620-e6e910bb420d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:54.569134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:54.575619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885661d-2728-4d1a-97c8-a7d39dba2a6d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:54.594049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab2ed5-4912-4c05-9a78-5c2bbfbd8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:54.595441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2ed5-4912-4c05-9a78-5c2bbfbd8a46 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.595951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2ed5-4912-4c05-9a78-5c2bbfbd8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.596954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab2ed5-4912-4c05-9a78-5c2bbfbd8a46 None admin] PATH_INFO: `/v3/users/1309f51714bc425caa70be3d6c622b5e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.598812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2ed5-4912-4c05-9a78-5c2bbfbd8a46 None admin] RBAC: Authorizing `identity:get_user(user_id=1309f51714bc425caa70be3d6c622b5e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:54.601386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab2ed5-4912-4c05-9a78-5c2bbfbd8a46 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:54.603948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 20/35] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:49:54 2022] GET /identity/v3/users/1309f51714bc425caa70be3d6c622b5e => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:54.606351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497689c6-5aa5-46e6-a5a7-f519c2379c77 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.606903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497689c6-5aa5-46e6-a5a7-f519c2379c77 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.607370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497689c6-5aa5-46e6-a5a7-f519c2379c77 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.610081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 21/36] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:54.611971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497689c6-5aa5-46e6-a5a7-f519c2379c77 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:54.628253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42698a6-1eea-4a22-841b-02f8563e7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:54.629071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42698a6-1eea-4a22-841b-02f8563e7a13 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.629454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42698a6-1eea-4a22-841b-02f8563e7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.629986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42698a6-1eea-4a22-841b-02f8563e7a13 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.631310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42698a6-1eea-4a22-841b-02f8563e7a13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:54.633012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42698a6-1eea-4a22-841b-02f8563e7a13 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:54.724141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 16/37] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:49:54 2022] POST /identity/v3/projects => generated 301 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:49:54.726477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fd391-576e-45ef-8045-82cb79f80b4a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.727619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fd391-576e-45ef-8045-82cb79f80b4a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.727619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fd391-576e-45ef-8045-82cb79f80b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.745090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497689c6-5aa5-46e6-a5a7-f519c2379c77 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:54.755212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-587fd391-576e-45ef-8045-82cb79f80b4a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:54.755955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-587fd391-576e-45ef-8045-82cb79f80b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:54.761943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:54.789175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:54.789863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.790155 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.790432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.792368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:54.793977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:54.795962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 22/38] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:49:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:54.796769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:54.847393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 17/39] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:49:54.860056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2583fa-4963-404d-8db3-038edc924596 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.860404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2583fa-4963-404d-8db3-038edc924596 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.860696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2583fa-4963-404d-8db3-038edc924596 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.862453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:54.863862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 18/40] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:54 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:54.864523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2583fa-4963-404d-8db3-038edc924596 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:54.921665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1943-a953-4555-9c23-e6f2e05ab5d5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:54.960735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:54.961390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:54.961671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:54.962023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:54.962705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:54.965086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:55.005272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2583fa-4963-404d-8db3-038edc924596 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:55.041425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8d150-4f39-41e9-813a-87cdf0d20174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:55.042182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d150-4f39-41e9-813a-87cdf0d20174 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:55.042380 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d150-4f39-41e9-813a-87cdf0d20174 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:55.042661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8d150-4f39-41e9-813a-87cdf0d20174 None admin] PATH_INFO: `/v3/domains/default/users/1309f51714bc425caa70be3d6c622b5e/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:55.044812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d150-4f39-41e9-813a-87cdf0d20174 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1309f51714bc425caa70be3d6c622b5e, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:55.046294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8d150-4f39-41e9-813a-87cdf0d20174 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:55.111552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:55.123946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1361 bytes} [Mon Oct 3 15:49:54 2022] PUT /identity/v3/domains/default/users/1309f51714bc425caa70be3d6c622b5e/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:49:55.123946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba502a7-5f36-4f11-9fa0-a1d9fc72bc50 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:55.123946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba502a7-5f36-4f11-9fa0-a1d9fc72bc50 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:55.123946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba502a7-5f36-4f11-9fa0-a1d9fc72bc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:55.140951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-fba502a7-5f36-4f11-9fa0-a1d9fc72bc50 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:55.142255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fba502a7-5f36-4f11-9fa0-a1d9fc72bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:55.221529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 20/42] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:49:55.222785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba502a7-5f36-4f11-9fa0-a1d9fc72bc50 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:55.244176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 23/43] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Oct 3 15:49:54 2022] POST /identity/v3/roles => generated 225 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:49:55.358158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba502a7-5f36-4f11-9fa0-a1d9fc72bc50 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:55.394158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:55.402425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:55.403522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:55.404082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:55.404586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:55.405516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:55.407182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:55.492926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 21/44] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Oct 3 15:49:55 2022] POST /identity/v3/roles => generated 223 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:49:55.538679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:55.654363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda76ec-2ae3-4480-ba3e-195f0717cf70 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:55.671037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:55.695385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899a7cd-85d9-4381-ab4f-8268490019f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:55.696038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899a7cd-85d9-4381-ab4f-8268490019f9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:55.696338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899a7cd-85d9-4381-ab4f-8268490019f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:55.696609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899a7cd-85d9-4381-ab4f-8268490019f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:55.698557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899a7cd-85d9-4381-ab4f-8268490019f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:55.699997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899a7cd-85d9-4381-ab4f-8268490019f9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:55.706079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 24/45] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:49:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:55.707652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:55.817171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a2c9d-9f55-412e-bffe-902584344f34 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:55.849743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3182ef-4259-45b2-8503-8bfa1e433fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:55.850373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3182ef-4259-45b2-8503-8bfa1e433fa3 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:55.850655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3182ef-4259-45b2-8503-8bfa1e433fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:55.850929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3182ef-4259-45b2-8503-8bfa1e433fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:55.851588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3182ef-4259-45b2-8503-8bfa1e433fa3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:55.853045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3182ef-4259-45b2-8503-8bfa1e433fa3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:55.927128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 22/46] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:49:55 2022] POST /identity/v3/projects => generated 312 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:49:57.326255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d12e-b579-40da-9178-7a2dcb83c50d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:57.326764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d12e-b579-40da-9178-7a2dcb83c50d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:57.326842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d12e-b579-40da-9178-7a2dcb83c50d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:57.328154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 25/47] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:57.333545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e26f3-2474-410b-b49d-2902a6078617 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:57.333978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e26f3-2474-410b-b49d-2902a6078617 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:57.334138 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e26f3-2474-410b-b49d-2902a6078617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:57.352278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e84e26f3-2474-410b-b49d-2902a6078617 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:57.353485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e84e26f3-2474-410b-b49d-2902a6078617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:57.388010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:57.420544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:49:57.685169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d12e-b579-40da-9178-7a2dcb83c50d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:57.789948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d12e-b579-40da-9178-7a2dcb83c50d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:57.823516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:57.824136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:57.824417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:57.824691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:57.835116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:49:57.840516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:49:57.841454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:49:57.842269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 26/49] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:49:57.847409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e26f3-2474-410b-b49d-2902a6078617 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:57.944749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e26f3-2474-410b-b49d-2902a6078617 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:58.088016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f740de3-b3a7-41ac-8f1f-ba92f6bde356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:58.088800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740de3-b3a7-41ac-8f1f-ba92f6bde356 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.089087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740de3-b3a7-41ac-8f1f-ba92f6bde356 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.089368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f740de3-b3a7-41ac-8f1f-ba92f6bde356 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.090079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f740de3-b3a7-41ac-8f1f-ba92f6bde356 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:49:58.090393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f740de3-b3a7-41ac-8f1f-ba92f6bde356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:58.091775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f740de3-b3a7-41ac-8f1f-ba92f6bde356 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:58.103967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 24/50] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:58.110690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:58.130284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f75a1-86e2-49b6-af48-88da4a486eb9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.130573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f75a1-86e2-49b6-af48-88da4a486eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.130856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f75a1-86e2-49b6-af48-88da4a486eb9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.132214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 25/51] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:49:58.137339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bc216-728e-4f37-84f8-4ec5683eddc6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.137627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bc216-728e-4f37-84f8-4ec5683eddc6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.137944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bc216-728e-4f37-84f8-4ec5683eddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.153351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:58.155370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b34bc216-728e-4f37-84f8-4ec5683eddc6 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:49:58.156564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b34bc216-728e-4f37-84f8-4ec5683eddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:49:58.185025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:58.215578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4580a2e-7fc0-4c56-bab7-3379bf0c9f74 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:58.224815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:49:58.249655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:58.250314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.250602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.250881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] PATH_INFO: `/v3/users/1309f51714bc425caa70be3d6c622b5e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.252130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] RBAC: Authorizing `identity:get_user(user_id=1309f51714bc425caa70be3d6c622b5e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:58.253587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:58.255203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:49:58 2022] GET /identity/v3/users/1309f51714bc425caa70be3d6c622b5e => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:58.260810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bc216-728e-4f37-84f8-4ec5683eddc6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:58.358380 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bc216-728e-4f37-84f8-4ec5683eddc6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:58.391264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:58.391891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.392170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.392444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.393614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:58.395085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:58.396633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:49:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:58.402980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:58.492632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:58.501355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173ad02-8fd1-4899-a4e3-fb8494fe237a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:58.510503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:58.523718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:49:58.534717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:58.535323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.535605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.535879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.536613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.domain.id=default, user.id=1309f51714bc425caa70be3d6c622b5e) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:49:58.536928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:58.538921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:58.545407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Oct 3 15:49:58 2022] GET /identity/v3/role_assignments?user.id=1309f51714bc425caa70be3d6c622b5e&scope.domain.id=default&role.id=722cda8b508d40678af249ff70cb0751 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:49:58.597243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1770d-7302-431a-8d58-8930fd4f74db None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:58.634445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fa0c0-20f0-4de5-aaae-da95db613156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:58.635660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fa0c0-20f0-4de5-aaae-da95db613156 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.635943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fa0c0-20f0-4de5-aaae-da95db613156 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.636217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fa0c0-20f0-4de5-aaae-da95db613156 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.637414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fa0c0-20f0-4de5-aaae-da95db613156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:58.638955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fa0c0-20f0-4de5-aaae-da95db613156 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:58.640581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:49:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:49:58.646251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:49:58.752350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2cada-a000-4ded-8339-8a2454dc01d8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:49:58.786169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab71999-e4e8-4b84-ad52-c37e08daa40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:49:58.786777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab71999-e4e8-4b84-ad52-c37e08daa40a None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:49:58.787059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab71999-e4e8-4b84-ad52-c37e08daa40a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:49:58.787333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab71999-e4e8-4b84-ad52-c37e08daa40a None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:49:58.787989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab71999-e4e8-4b84-ad52-c37e08daa40a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:49:58.789441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab71999-e4e8-4b84-ad52-c37e08daa40a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:49:58.892318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Oct 3 15:49:58 2022] POST /identity/v3/projects => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:01.045264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73bf19-9648-4d21-b958-1b88978c8c46 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:01.045785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73bf19-9648-4d21-b958-1b88978c8c46 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:01.045785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73bf19-9648-4d21-b958-1b88978c8c46 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:01.047124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:01.052416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa557-4e5f-4325-89eb-a7175ad782c4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:01.052818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa557-4e5f-4325-89eb-a7175ad782c4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:01.052987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa557-4e5f-4325-89eb-a7175ad782c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:01.072744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9f8aa557-4e5f-4325-89eb-a7175ad782c4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:01.074293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9f8aa557-4e5f-4325-89eb-a7175ad782c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:01.091660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:01.141451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:01.409549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73bf19-9648-4d21-b958-1b88978c8c46 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:01.506618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:01.510801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73bf19-9648-4d21-b958-1b88978c8c46 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:01.542397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16b9ac-32f7-4433-b826-96006286044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:01.543013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16b9ac-32f7-4433-b826-96006286044f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:01.543335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16b9ac-32f7-4433-b826-96006286044f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:01.543610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16b9ac-32f7-4433-b826-96006286044f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:01.544691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16b9ac-32f7-4433-b826-96006286044f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:01.546157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16b9ac-32f7-4433-b826-96006286044f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:01.547730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:01.553338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa557-4e5f-4325-89eb-a7175ad782c4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:01.648977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa557-4e5f-4325-89eb-a7175ad782c4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:01.680984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942b537-79c1-485b-9b03-e16f62b49f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:01.682242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b537-79c1-485b-9b03-e16f62b49f83 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:01.682524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b537-79c1-485b-9b03-e16f62b49f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:01.682794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942b537-79c1-485b-9b03-e16f62b49f83 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:01.683436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942b537-79c1-485b-9b03-e16f62b49f83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:01.684864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942b537-79c1-485b-9b03-e16f62b49f83 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:01.798495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:50:01 2022] POST /identity/v3/users => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:05.201572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763dbc-2752-4fe6-b9b7-e85d68956921 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.202462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763dbc-2752-4fe6-b9b7-e85d68956921 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.202878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89763dbc-2752-4fe6-b9b7-e85d68956921 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.204716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:05.210410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817125-cfc4-4d4b-88fe-d13fea688625 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.210880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817125-cfc4-4d4b-88fe-d13fea688625 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.210980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817125-cfc4-4d4b-88fe-d13fea688625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.235147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b7817125-cfc4-4d4b-88fe-d13fea688625 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:05.236378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b7817125-cfc4-4d4b-88fe-d13fea688625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:05.240646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:05.314247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef524cf-b415-4eb8-be03-f6c8f3507e94 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.314803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef524cf-b415-4eb8-be03-f6c8f3507e94 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.315277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef524cf-b415-4eb8-be03-f6c8f3507e94 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.316797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:05.323872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b933-778e-4ca9-ab52-aca8b4b9c779 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.324566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b933-778e-4ca9-ab52-aca8b4b9c779 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.325036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646b933-778e-4ca9-ab52-aca8b4b9c779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.328221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:05.365169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f646b933-778e-4ca9-ab52-aca8b4b9c779 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:05.365924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035e91-e889-42e8-ade5-fe134e0c365c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.366214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035e91-e889-42e8-ade5-fe134e0c365c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.366650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb035e91-e889-42e8-ade5-fe134e0c365c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.367167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f646b933-778e-4ca9-ab52-aca8b4b9c779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:05.368281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 33/65] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:05.375817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9411-2680-4418-8cf8-0071daf1c8a4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.376105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9411-2680-4418-8cf8-0071daf1c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.376394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e9411-2680-4418-8cf8-0071daf1c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.398558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-183e9411-2680-4418-8cf8-0071daf1c8a4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:05.401504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-183e9411-2680-4418-8cf8-0071daf1c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:05.500122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 33/66] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:05.504068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:05.619415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646b933-778e-4ca9-ab52-aca8b4b9c779 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:05.688694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7eed-de0d-4cfa-b288-a6c498537c94 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.689330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7eed-de0d-4cfa-b288-a6c498537c94 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.689856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7eed-de0d-4cfa-b288-a6c498537c94 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.691587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 35/68] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:05.697555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326b56-5bbe-4912-bfa5-3d19af74ccf6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.698573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326b56-5bbe-4912-bfa5-3d19af74ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.699048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62326b56-5bbe-4912-bfa5-3d19af74ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.723988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-62326b56-5bbe-4912-bfa5-3d19af74ccf6 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:05.725734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-62326b56-5bbe-4912-bfa5-3d19af74ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:05.749869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646b933-778e-4ca9-ab52-aca8b4b9c779 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:05.752509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:05.810382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:05.811119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:05.811406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:05.811744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:05.836533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:05.845781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:05.846709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:05.847491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:05.848112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:05.849465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:05.852922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 36/70] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:05.861957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62326b56-5bbe-4912-bfa5-3d19af74ccf6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:05.966299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62326b56-5bbe-4912-bfa5-3d19af74ccf6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:05.990389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5ea10-96b9-4605-a18a-398f18f76500 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.002829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.003378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.003660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.003957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.004642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:06.004946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.006414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.014541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 37/71] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.019907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.026580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048400c0-1180-4a4e-b24b-69ca581ca944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.027222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048400c0-1180-4a4e-b24b-69ca581ca944 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.027497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048400c0-1180-4a4e-b24b-69ca581ca944 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.027777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048400c0-1180-4a4e-b24b-69ca581ca944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.039592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048400c0-1180-4a4e-b24b-69ca581ca944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-048400c0-1180-4a4e-b24b-69ca581ca944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:06.045309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:06.046184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:06.047210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 35/72] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:06.052767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9072f5-300c-4e96-bf41-a85b7e5379aa None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.053057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9072f5-300c-4e96-bf41-a85b7e5379aa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.053339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9072f5-300c-4e96-bf41-a85b7e5379aa None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.054616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 36/73] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:06.058002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9072f5-300c-4e96-bf41-a85b7e5379aa None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.076812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.090671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.129622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5074dce-8b44-4ff9-b2f9-a8b2bf246c25 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.164208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.164843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.165127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.165405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.166746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9072f5-300c-4e96-bf41-a85b7e5379aa None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.175879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:06.181708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:06.182742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:06.183512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:06.184149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.203902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33edaf4-8bdc-47ec-aacf-aa74749e52a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.204532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33edaf4-8bdc-47ec-aacf-aa74749e52a5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.204815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33edaf4-8bdc-47ec-aacf-aa74749e52a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.205087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33edaf4-8bdc-47ec-aacf-aa74749e52a5 None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.220623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33edaf4-8bdc-47ec-aacf-aa74749e52a5 None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.222122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33edaf4-8bdc-47ec-aacf-aa74749e52a5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.223724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.226087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65cc95-d9e0-41cf-8abf-1f475c2db237 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.226379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65cc95-d9e0-41cf-8abf-1f475c2db237 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.226655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65cc95-d9e0-41cf-8abf-1f475c2db237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.245546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bc65cc95-d9e0-41cf-8abf-1f475c2db237 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:06.246935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bc65cc95-d9e0-41cf-8abf-1f475c2db237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:06.288955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cf7c6-5bbe-47e5-b15b-eff04350829d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.311980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.313160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 38/76] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:06.314024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65cc95-d9e0-41cf-8abf-1f475c2db237 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.321823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.328807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.329424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.329708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.330146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.330672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:06.330978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.332640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.345931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 39/77] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.345931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.430382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65cc95-d9e0-41cf-8abf-1f475c2db237 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.451069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4834e-fdba-4652-be85-45bf00bc1836 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.468564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.469692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.470169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.470584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.483902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:06.486183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.486799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.487089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.487367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.488029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:06.488336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:06.488770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:06.489590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:06.490781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:06.491699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.491768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:06.491768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.504472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.505967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.558198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.565535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.592779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567201a-2cec-44a6-ba47-8bc68d6e2e32 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.622133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862fbf-c2e9-4358-a018-fbf017f9b774 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.628997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.629584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.629895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.630174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.655622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.656246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.656530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.656806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] PATH_INFO: `/v3/users/1309f51714bc425caa70be3d6c622b5e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.657957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] RBAC: Authorizing `identity:get_user(user_id=1309f51714bc425caa70be3d6c622b5e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.659415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.660975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 41/80] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/users/1309f51714bc425caa70be3d6c622b5e => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.661831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.700065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.701556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.766399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.773459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21a959-1522-4e8b-a7ac-e595a47ebe83 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.787262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:06.801921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 40/81] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:06.803012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.807280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.813782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.813782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.813782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.813782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:06.813782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.813782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.819330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 42/82] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.819931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.907541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbc1e0-e5b6-48ff-a311-231e02746d92 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.918348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6534d-70b2-4ad3-8cf8-e41d5c65fee4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:06.941596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.942250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.942529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.942801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.943919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.945365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.947625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 41/83] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.948386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.953402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:06.954071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:06.954356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:06.954636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:06.955744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:06.957452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:06.959041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 43/84] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:06.959793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:06.983611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.007635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.049451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92ffa0-390a-4cb0-ac41-b1d1e9778b19 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.062719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf2d58-7cbf-4555-b6fe-9865c2914db0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.084068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.084609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.084893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.085164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.095010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.095641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.095924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.096203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.097329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.098821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.100666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 44/85] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:07.101202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:07.151942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.153433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.185711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.201174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12ddd-9413-4fef-9ff3-10acee71767b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.214004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.235761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.236396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.236683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.236966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.238243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.239746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.241344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 45/86] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:07 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:07.242142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:07.261370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 42/87] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:07.261370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:07.341502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92947-68b7-4bed-8ca5-cc1cce06ddd9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.356487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4b20f-76a8-469a-bfc3-6f7589e537c0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.374757 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.375365 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.375644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.375914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.391692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.392300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.392586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.392864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.393517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.395023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.406691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.426250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.444509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.446024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.530116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 43/88] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:50:07 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:07.530953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:07.546264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 46/89] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:07.546264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:07.638568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.660660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c948fe-0911-4bdf-9798-34c933d5c452 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.662983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d354b2-ce85-4f89-b7d2-fa6a3711a68a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.700593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.700791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.701225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.701414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.701508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.701695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.701817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.701997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.702760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=3799900f832343e982b92b4fa868b5bf) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:07.703036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.704476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.713478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 44/90] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:07 2022] GET /identity/v3/role_assignments?user.id=3799900f832343e982b92b4fa868b5bf&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=c2fb856e141d464e9be4bbf269169309 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:07.713708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:07.788451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.789458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.790015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.861576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c6a12-a99e-4e39-abbf-b0aeab59a473 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:07.901643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:07.914981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:07.916739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:07.917029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:07.917313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:07.918786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:07.920141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:07.922084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 45/91] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:07 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:07.922590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:07.928945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 47/92] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:07.929684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:08.058444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933eae4-86c0-4c9e-a189-fad1604bc97a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:08.062723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2c7a-ba09-4b7b-890d-6321accf2451 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:08.084100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:08.097052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:08.098121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:08.098579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:08.099023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:08.100447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:08.102791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:08.106083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 46/93] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:07 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:08.106959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:08.107337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:08.107714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:08.108070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:08.108423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:08.109236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=1309f51714bc425caa70be3d6c622b5e) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:08.109614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:08.111382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:08.119768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 48/94] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:07 2022] GET /identity/v3/role_assignments?user.id=1309f51714bc425caa70be3d6c622b5e&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:08.120609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:08.190164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:08.242570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0653f6-8233-4afd-8ffc-4a93953f93bb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:08.258042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ebc3-4e98-445c-a215-e61953bd0417 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:08.289989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:08.291653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:08.292070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:08.292360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] PATH_INFO: `/v3/projects/12998201febe4f6592b926d6e4a5fb3b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:08.294001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] RBAC: Authorizing `identity:get_project(project_id=12998201febe4f6592b926d6e4a5fb3b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:08.295635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:08.298102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 47/95] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:08 2022] GET /identity/v3/projects/12998201febe4f6592b926d6e4a5fb3b => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:08.300664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a63f-dc3d-4c9a-9ac7-91308c15615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:08.301350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a63f-dc3d-4c9a-9ac7-91308c15615e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:08.301700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a63f-dc3d-4c9a-9ac7-91308c15615e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:08.302072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a63f-dc3d-4c9a-9ac7-91308c15615e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:08.302964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707a63f-dc3d-4c9a-9ac7-91308c15615e None admin] RBAC: Adding query filter params (role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=3799900f832343e982b92b4fa868b5bf) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:08.303360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707a63f-dc3d-4c9a-9ac7-91308c15615e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:08.303919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:08.305062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707a63f-dc3d-4c9a-9ac7-91308c15615e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:08.311589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 49/96] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:08 2022] GET /identity/v3/role_assignments?user.id=3799900f832343e982b92b4fa868b5bf&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=4eba1d0edde84f6da82050340e36f845 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:08.378427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:08.430468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc60b78-a5e8-490b-b138-80448523246a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:08.513579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6938-3053-476e-a0e4-2e249cefbcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:08.514152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6938-3053-476e-a0e4-2e249cefbcad None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:08.514440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6938-3053-476e-a0e4-2e249cefbcad None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:08.514718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6938-3053-476e-a0e4-2e249cefbcad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:08.515458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f6938-3053-476e-a0e4-2e249cefbcad None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=12998201febe4f6592b926d6e4a5fb3b, user.id=3799900f832343e982b92b4fa868b5bf) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:08.515773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f6938-3053-476e-a0e4-2e249cefbcad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:08.517234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f6938-3053-476e-a0e4-2e249cefbcad None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:08.523715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 48/97] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:08 2022] GET /identity/v3/role_assignments?user.id=3799900f832343e982b92b4fa868b5bf&scope.project.id=12998201febe4f6592b926d6e4a5fb3b&role.id=c2fb856e141d464e9be4bbf269169309 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:10.433461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5806-5fae-4574-9501-0ac9a058d40f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:10.434610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5806-5fae-4574-9501-0ac9a058d40f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:10.435091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb5806-5fae-4574-9501-0ac9a058d40f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:10.436920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 50/98] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:10.451149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8ec4-47d1-4fae-80ee-6d34df95279e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:10.452049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8ec4-47d1-4fae-80ee-6d34df95279e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:10.452483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8ec4-47d1-4fae-80ee-6d34df95279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:10.474480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d29c8ec4-47d1-4fae-80ee-6d34df95279e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:10.475970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d29c8ec4-47d1-4fae-80ee-6d34df95279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:10.546566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:10.759035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0fec2-886e-4645-8095-2950671fef4c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:10.759887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0fec2-886e-4645-8095-2950671fef4c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:10.760407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0fec2-886e-4645-8095-2950671fef4c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:10.762058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 51/100] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:10.768053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15642c-3865-4d51-a105-612906b5709c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:10.768639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15642c-3865-4d51-a105-612906b5709c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:10.769143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15642c-3865-4d51-a105-612906b5709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:10.794828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-fe15642c-3865-4d51-a105-612906b5709c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:10.796365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fe15642c-3865-4d51-a105-612906b5709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:10.859170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:10.890488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:10.937812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0fec2-886e-4645-8095-2950671fef4c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:10.955832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8daf99-d630-49e4-a7be-1bb7456be410 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:10.956152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8daf99-d630-49e4-a7be-1bb7456be410 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:10.956667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8daf99-d630-49e4-a7be-1bb7456be410 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:10.958052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 51/102] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:10.976769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e82c-d92b-42fd-ac23-82d310246a54 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:10.977362 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e82c-d92b-42fd-ac23-82d310246a54 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:10.978470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e82c-d92b-42fd-ac23-82d310246a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.018946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4f21e82c-d92b-42fd-ac23-82d310246a54 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:11.020450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4f21e82c-d92b-42fd-ac23-82d310246a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:11.142014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0fec2-886e-4645-8095-2950671fef4c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:11.148831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 52/103] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:11.159833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:11.188589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:11.189464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:11.194172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:11.194713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.205811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:11.215487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:11.216440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:11.217201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:11.219094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 52/104] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:11.225043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e82c-d92b-42fd-ac23-82d310246a54 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:11.250277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:11.381812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e82c-d92b-42fd-ac23-82d310246a54 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:11.405755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:11.418956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:11.419851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:11.420329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:11.420766 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.421599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:11.422093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:11.423641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:11.432667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 53/105] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:11.438390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:11.485782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66377b-59c7-4b6a-8dab-7f2d802fe872 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:11.557834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663086a-dfc9-4aa5-98d2-f23b801511dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:11.558480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663086a-dfc9-4aa5-98d2-f23b801511dd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:11.558778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663086a-dfc9-4aa5-98d2-f23b801511dd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:11.559064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663086a-dfc9-4aa5-98d2-f23b801511dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.579791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b61bb6-4455-4ae5-8807-f29a0b04a099 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:11.610573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663086a-dfc9-4aa5-98d2-f23b801511dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1663086a-dfc9-4aa5-98d2-f23b801511dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:11.616256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:11.617199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:11.618054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 53/106] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:11.619824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ef487-d509-4306-a47e-28d5b6108589 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:11.619919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ef487-d509-4306-a47e-28d5b6108589 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:11.620170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ef487-d509-4306-a47e-28d5b6108589 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.630365 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 54/107] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:11.631011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc00a5c-8760-4ca7-bf38-524d48258146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:11.631148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ef487-d509-4306-a47e-28d5b6108589 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:11.632276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00a5c-8760-4ca7-bf38-524d48258146 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:11.632770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00a5c-8760-4ca7-bf38-524d48258146 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:11.633260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc00a5c-8760-4ca7-bf38-524d48258146 None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.634864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc00a5c-8760-4ca7-bf38-524d48258146 None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:11.636876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc00a5c-8760-4ca7-bf38-524d48258146 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:11.638748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 54/108] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:11 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:11.641113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6f92-711c-48f5-815a-a6672d287f73 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:11.641630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6f92-711c-48f5-815a-a6672d287f73 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:11.642139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6f92-711c-48f5-815a-a6672d287f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.666924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-55cf6f92-711c-48f5-815a-a6672d287f73 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:11.668910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-55cf6f92-711c-48f5-815a-a6672d287f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:11.679636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:11.715121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:11.756231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ef487-d509-4306-a47e-28d5b6108589 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:11.775035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 55/109] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:11.776188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6f92-711c-48f5-815a-a6672d287f73 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:11.815073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:11.817612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:11.818148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:11.818658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:11.820958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:11.821470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:11.825046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:11.847519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 55/110] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:11.848750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:11.964596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6f92-711c-48f5-815a-a6672d287f73 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.010021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.012258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.014363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.014887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.017989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:12.021131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:12.025749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 56/111] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:11 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:12.030727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:12.089081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:12.095975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:12.106889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5c821-43eb-48ed-b6b4-ad22164e690a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.149240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.151313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.151599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.151881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.153013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:12.154524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:12.156251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 56/112] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:12.156836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:12.161290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ca345-df4d-43b3-94e1-7166ff360d29 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.195480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.196112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.196392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.196831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] PATH_INFO: `/v3/users/2dc70e207356497692776610f97a2925` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.210659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] RBAC: Authorizing `identity:get_user(user_id=2dc70e207356497692776610f97a2925)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:12.212677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:12.214357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 57/113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:12 2022] GET /identity/v3/users/2dc70e207356497692776610f97a2925 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:12.215188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:12.260039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020f5fb-c511-403c-b130-65ee74c5659f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.295143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.295801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.296089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.296367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/3799900f832343e982b92b4fa868b5bf/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.298318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] RBAC: Authorizing `identity:create_grant(project_id=01d335aab075477caa5c8e2d01f3ff8a, user_id=3799900f832343e982b92b4fa868b5bf, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:12.299792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:12.312076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:12.315604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343907d2-a4dc-479f-9cbe-d28d3ffbd99e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.352506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132194c4-0c17-404e-a551-f9908a846263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.353863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132194c4-0c17-404e-a551-f9908a846263 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.354316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132194c4-0c17-404e-a551-f9908a846263 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.354602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132194c4-0c17-404e-a551-f9908a846263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.364996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132194c4-0c17-404e-a551-f9908a846263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-132194c4-0c17-404e-a551-f9908a846263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:12.370674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:12.377287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:12.378122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 58/114] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:12.378759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 57/115] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:12 2022] PUT /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/3799900f832343e982b92b4fa868b5bf/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:12.378827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739383-9351-44c4-beb7-f0a70edafb8f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.378827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739383-9351-44c4-beb7-f0a70edafb8f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.378827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc739383-9351-44c4-beb7-f0a70edafb8f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.379005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:12.379069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 59/116] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:12.380743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0fc71-4f6f-451c-9c17-049579444daa None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.381944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0fc71-4f6f-451c-9c17-049579444daa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.381944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0fc71-4f6f-451c-9c17-049579444daa None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.387031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 60/117] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:12.387031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0fc71-4f6f-451c-9c17-049579444daa None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:12.411879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:12.504943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0fc71-4f6f-451c-9c17-049579444daa None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.509670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba1e94-4bed-4803-80eb-d854dcbc469c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.542304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e996e-adca-4ac7-82e6-3928f7791a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.542933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e996e-adca-4ac7-82e6-3928f7791a81 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.543219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e996e-adca-4ac7-82e6-3928f7791a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.544978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e996e-adca-4ac7-82e6-3928f7791a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.553791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.553791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.553791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.553791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.554172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:12.557941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:12.581289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:12.623072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e996e-adca-4ac7-82e6-3928f7791a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:12.624555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e996e-adca-4ac7-82e6-3928f7791a81 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:12.642343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 58/118] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:50:12 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:12.643292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:12.782561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:12.789800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 61/119] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:12.789800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2448fbe-3031-4f54-9428-86edc15770ac None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.789800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2448fbe-3031-4f54-9428-86edc15770ac None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.789800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2448fbe-3031-4f54-9428-86edc15770ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.821492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e2448fbe-3031-4f54-9428-86edc15770ac None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:12.824209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e2448fbe-3031-4f54-9428-86edc15770ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:12.853377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a324437-a3c7-458b-bc89-f1a7cd73c804 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:12.914425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afd087-f2f5-4d75-963e-a084c9300bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:12.915532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd087-f2f5-4d75-963e-a084c9300bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.915852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd087-f2f5-4d75-963e-a084c9300bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.916181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afd087-f2f5-4d75-963e-a084c9300bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.916817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:12.918775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd087-f2f5-4d75-963e-a084c9300bb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:12.918775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd087-f2f5-4d75-963e-a084c9300bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:12.919636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afd087-f2f5-4d75-963e-a084c9300bb2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:12.928701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 59/120] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:12.930413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e54e40-3165-4642-a0dd-72cbc70b82a7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:12.930413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e54e40-3165-4642-a0dd-72cbc70b82a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:12.930681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e54e40-3165-4642-a0dd-72cbc70b82a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:12.951085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f7e54e40-3165-4642-a0dd-72cbc70b82a7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:12.952294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f7e54e40-3165-4642-a0dd-72cbc70b82a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:12.957039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 62/121] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:12.958803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2448fbe-3031-4f54-9428-86edc15770ac None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.133651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 60/122] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:13.138177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e54e40-3165-4642-a0dd-72cbc70b82a7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.149231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2448fbe-3031-4f54-9428-86edc15770ac None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:13.228476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:13.229998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:13.230791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:13.231532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:13.233744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:13.236913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:13.240628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 63/123] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:12 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:13.251014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.306987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:13.339852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:13.359622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e54e40-3165-4642-a0dd-72cbc70b82a7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:13.385662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5835e1-dfd3-4b77-bfc1-674eb6294bc3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:13.395549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:13.396445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:13.396921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:13.397334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] PATH_INFO: `/v3/users/1309f51714bc425caa70be3d6c622b5e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:13.398690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] RBAC: Authorizing `identity:get_user(user_id=1309f51714bc425caa70be3d6c622b5e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:13.400845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:13.402617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 61/124] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:13 2022] GET /identity/v3/users/1309f51714bc425caa70be3d6c622b5e => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:13.403574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.427693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:13.428475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:13.428822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:13.431509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:13.431509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] RBAC: Adding query filter params (role.id=5fe956d1e23649e48d1c67402b297718, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=2dc70e207356497692776610f97a2925) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:13.431509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:13.432592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:13.438606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 64/125] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:13 2022] GET /identity/v3/role_assignments?user.id=2dc70e207356497692776610f97a2925&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=5fe956d1e23649e48d1c67402b297718 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:13.440691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.555264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219656b-3c2b-451a-a534-14485778eb90 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:13.615150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:13.626831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:13.631598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:13.631598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:13.631598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:13.658212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:13.672919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87b8b3-2901-4410-bc57-3ac9ff219830 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:13.674997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:13.676022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:13.677055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 62/126] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:13.677817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.723097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:13.752852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:13.753643 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:13.754237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:13.754746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:13.757830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:13.760019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:13.769635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 65/127] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:13 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:13.770631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.865934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a8f5-2a87-434b-b885-16289803a86d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:13.930680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:13.931336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:13.931635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:13.931914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:13.944755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a1348-6190-4820-bd77-b04f5e1262b9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:13.955969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:13.971041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:13.971916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 63/128] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:13.973094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:13.983806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:13.984436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:13.984784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:13.985072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:13.985743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:13.986093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:13.987492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.008278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 66/129] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:14.011326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:14.080534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:14.108531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:14.172165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526131a-836d-40f5-ba1a-1c96ee10585e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:14.179862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6370d-2266-4d9c-9ad0-740b850c3489 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:14.214943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:14.215479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.215815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.216090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.216761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:14.217067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:14.218475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.231223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 67/130] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:14.232140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:14.266689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:14.267390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.267682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.267970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/1309f51714bc425caa70be3d6c622b5e/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.270085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] RBAC: Authorizing `identity:create_grant(project_id=01d335aab075477caa5c8e2d01f3ff8a, user_id=1309f51714bc425caa70be3d6c622b5e, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:14.271560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.344087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5028-6620-4a7e-b325-43e30eaa919a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:14.358558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:14.372242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 64/131] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:13 2022] PUT /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/1309f51714bc425caa70be3d6c622b5e/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:14.373099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:14.382223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:14.382939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.383274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.383553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.385046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:14.386607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.388319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 68/132] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:14 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:14.394312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:14.514606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303272-ef6e-4404-9499-6e6e84ee293d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:14.554691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:14.555377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.555666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.556617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.558292 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:14.559690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.561422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 69/133] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:14 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:14.568236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:14.627664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:14.631994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba708-bb46-4481-b376-8183ae75e44e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:14.650604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:14.693801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7e0d-4248-4a4c-acca-d481f0def819 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:14.700994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:14.702192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.702485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.702764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.704313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:14.706785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.709329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 65/134] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:14 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:14.714456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:14.746518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:14.747459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.747848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.748398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/3799900f832343e982b92b4fa868b5bf/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.750899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=01d335aab075477caa5c8e2d01f3ff8a, user_id=3799900f832343e982b92b4fa868b5bf, role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:14.752491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.829974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 70/135] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:14 2022] PUT /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/3799900f832343e982b92b4fa868b5bf/roles/4eba1d0edde84f6da82050340e36f845 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:14.861389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a539bc-fbbd-4065-a86c-0f3605402fc8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:14.902349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95840d6b-f65f-4b7d-9be7-4522160a5744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:14.903009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840d6b-f65f-4b7d-9be7-4522160a5744 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.903295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840d6b-f65f-4b7d-9be7-4522160a5744 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.903631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840d6b-f65f-4b7d-9be7-4522160a5744 None admin] PATH_INFO: `/v3/projects/12998201febe4f6592b926d6e4a5fb3b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.904928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95840d6b-f65f-4b7d-9be7-4522160a5744 None admin] RBAC: Authorizing `identity:get_project(project_id=12998201febe4f6592b926d6e4a5fb3b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:14.906559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95840d6b-f65f-4b7d-9be7-4522160a5744 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:14.908591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 66/136] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:14 2022] GET /identity/v3/projects/12998201febe4f6592b926d6e4a5fb3b => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:14.914540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:14.923843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126f01-b2d7-4762-bf17-23376513cfbf None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.923843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126f01-b2d7-4762-bf17-23376513cfbf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.923843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db126f01-b2d7-4762-bf17-23376513cfbf None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.923843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 67/137] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:14.930187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a66a3-aa23-4300-ab2c-097bc2935a29 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:14.930478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a66a3-aa23-4300-ab2c-097bc2935a29 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:14.930761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a66a3-aa23-4300-ab2c-097bc2935a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:14.953251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-921a66a3-aa23-4300-ab2c-097bc2935a29 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:14.954916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-921a66a3-aa23-4300-ab2c-097bc2935a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:15.012550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:15.046650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 68/138] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:15.107098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab518a-cea1-4200-ad20-85716a837bc5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:15.122305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:15.152153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:15.152829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:15.153114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:15.153391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] PATH_INFO: `/v3/projects/12998201febe4f6592b926d6e4a5fb3b/users/3799900f832343e982b92b4fa868b5bf/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:15.155440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] RBAC: Authorizing `identity:create_grant(project_id=12998201febe4f6592b926d6e4a5fb3b, user_id=3799900f832343e982b92b4fa868b5bf, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:15.156883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:15.239359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 71/139] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:14 2022] PUT /identity/v3/projects/12998201febe4f6592b926d6e4a5fb3b/users/3799900f832343e982b92b4fa868b5bf/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:15.418976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a66a3-aa23-4300-ab2c-097bc2935a29 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:15.554436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a66a3-aa23-4300-ab2c-097bc2935a29 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:15.598207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:15.599211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:15.599713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:15.599994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:15.612489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:15.617639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:15.618570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:15.619351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 69/140] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:15.625153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:15.774078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f62a2b-2529-4574-b36d-fbd9261e8720 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:15.822901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a7a6-63bb-44df-9061-eb7f86abb30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:15.823550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a7a6-63bb-44df-9061-eb7f86abb30c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:15.823814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a7a6-63bb-44df-9061-eb7f86abb30c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:15.824090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a7a6-63bb-44df-9061-eb7f86abb30c None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:15.824764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a7a6-63bb-44df-9061-eb7f86abb30c None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:15.825067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a7a6-63bb-44df-9061-eb7f86abb30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:15.826485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a7a6-63bb-44df-9061-eb7f86abb30c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:15.838462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 72/141] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:15.844401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:15.885532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:15.943998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bdbc1-0603-4835-8fac-42d00171330e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:15.944297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bdbc1-0603-4835-8fac-42d00171330e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:15.944554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bdbc1-0603-4835-8fac-42d00171330e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:15.946125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 73/142] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:15.951984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf2d18-194a-4b8f-bb87-d0b3d3b70cc3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:15.952276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf2d18-194a-4b8f-bb87-d0b3d3b70cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:15.952565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf2d18-194a-4b8f-bb87-d0b3d3b70cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:15.974060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9891fc-6441-4a89-b70f-502452f01645 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:16.002958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c4cf2d18-194a-4b8f-bb87-d0b3d3b70cc3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:16.004055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c4cf2d18-194a-4b8f-bb87-d0b3d3b70cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:16.026526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:16.027181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:16.027479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:16.028172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:16.034240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:16.036042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:16.037999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 70/143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:15 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:16.043980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:16.063235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:16.176174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 74/144] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 03 15:50:16.199945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e3c6b-fda6-4c07-add2-3c8669e445eb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:16.207014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:16.250030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:16.251923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:16.252471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:16.252942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:16.357511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:16.357511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:16.463260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 71/145] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 15:50:16.468950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf2d18-194a-4b8f-bb87-d0b3d3b70cc3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:16.583361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf2d18-194a-4b8f-bb87-d0b3d3b70cc3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:16.626759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:16.627731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:16.628197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:16.628653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:16.631046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:16.632712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:16.634956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 75/146] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:16 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:16.641165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:16.644466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:16.754162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:16.800599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cacd8a-f062-40b8-a002-b905b16302e7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:16.804912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:16.860420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5ff6b-4150-4ea2-8e4b-5ab548c48e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:16.861088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ff6b-4150-4ea2-8e4b-5ab548c48e5c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:16.862870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ff6b-4150-4ea2-8e4b-5ab548c48e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:16.862870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ff6b-4150-4ea2-8e4b-5ab548c48e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:16.862870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5ff6b-4150-4ea2-8e4b-5ab548c48e5c None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=3799900f832343e982b92b4fa868b5bf) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:16.862870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5ff6b-4150-4ea2-8e4b-5ab548c48e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:16.864190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5ff6b-4150-4ea2-8e4b-5ab548c48e5c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:16.871227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 72/147] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:16 2022] GET /identity/v3/role_assignments?user.id=3799900f832343e982b92b4fa868b5bf&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=c2fb856e141d464e9be4bbf269169309 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:16.932988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5dd47-bcb6-4c1d-ab2f-a5f43c5e62a3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:16.977123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:16.978350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:16.978638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:16.978916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:16.980086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:16.981567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:16.983224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 76/148] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:16.988997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:16.990315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e353-165f-4de4-bd39-67b784375551 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:16.991033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e353-165f-4de4-bd39-67b784375551 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:16.991318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0e353-165f-4de4-bd39-67b784375551 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:16.992794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 73/149] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:17.006745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc979-49b9-4fe0-9840-323194fd58e9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:17.007087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc979-49b9-4fe0-9840-323194fd58e9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:17.007373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc979-49b9-4fe0-9840-323194fd58e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:17.046413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-203fc979-49b9-4fe0-9840-323194fd58e9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:17.047650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-203fc979-49b9-4fe0-9840-323194fd58e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:17.143579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:17.151277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 74/150] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:17.161906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:17.161906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97613e08-09e1-43ad-85c6-646cd62ce10a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:17.195097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:17.195640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:17.195926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:17.196201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:17.196929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:17.198515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:17.310013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 77/151] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:50:16 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:17.557862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc979-49b9-4fe0-9840-323194fd58e9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:17.676426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc979-49b9-4fe0-9840-323194fd58e9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:17.715827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab515547-13e2-4b1b-ae92-727116d35304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:17.716904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515547-13e2-4b1b-ae92-727116d35304 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:17.717408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515547-13e2-4b1b-ae92-727116d35304 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:17.717930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab515547-13e2-4b1b-ae92-727116d35304 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:17.730393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab515547-13e2-4b1b-ae92-727116d35304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ab515547-13e2-4b1b-ae92-727116d35304 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:17.737816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:17.738697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:17.739500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 75/152] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:17.742605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:17.810407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8b59-8f5b-4c3a-8e09-2ad4dcacac69 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:17.810669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8b59-8f5b-4c3a-8e09-2ad4dcacac69 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:17.810904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8b59-8f5b-4c3a-8e09-2ad4dcacac69 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:17.812259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 76/153] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:17.818610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aaed7-be89-4b6f-9b32-cc4557a091f3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:17.818897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aaed7-be89-4b6f-9b32-cc4557a091f3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:17.819176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aaed7-be89-4b6f-9b32-cc4557a091f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:17.841511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ff9aaed7-be89-4b6f-9b32-cc4557a091f3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:17.843631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ff9aaed7-be89-4b6f-9b32-cc4557a091f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:17.878609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9317ab-95c7-4edc-acc5-bcddf4e51d9d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:17.921466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:17.922129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:17.922411 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:17.922683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:17.923354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:17.923657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:17.923766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:17.925041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:17.934130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 78/154] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:17.940296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:17.951874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 77/155] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:17.957754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:18.009579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d19b-9077-44d1-abed-07f4a9657b70 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.010432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d19b-9077-44d1-abed-07f4a9657b70 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.010670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d19b-9077-44d1-abed-07f4a9657b70 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.012023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 78/156] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:18.019562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce272a-3c4a-4fa7-b4ff-48135b1ad693 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.019851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce272a-3c4a-4fa7-b4ff-48135b1ad693 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.020129 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce272a-3c4a-4fa7-b4ff-48135b1ad693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.047490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-76ce272a-3c4a-4fa7-b4ff-48135b1ad693 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:18.049295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-76ce272a-3c4a-4fa7-b4ff-48135b1ad693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:18.049950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f0fd3-f5c1-49df-85f7-f267aa114b3e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:18.096396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:18.096857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.097373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.097813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] PATH_INFO: `/v3/users/2dc70e207356497692776610f97a2925` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.099326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=2dc70e207356497692776610f97a2925)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:18.101824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:18.103917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 79/157] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:17 2022] GET /identity/v3/users/2dc70e207356497692776610f97a2925 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:18.110046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:18.154028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 79/158] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:18.213168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:18.232913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6288094-7131-45c4-b70b-04dc9e47b0e1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:18.273796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:18.273796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.273796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.273796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.274190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:18.274190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:18.275902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 80/159] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:18 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:18.285790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce272a-3c4a-4fa7-b4ff-48135b1ad693 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:18.308614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:18.426426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce272a-3c4a-4fa7-b4ff-48135b1ad693 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:18.454969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:18.458868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16a239-77da-4c9a-bfd9-ae0ecb73017c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:18.475738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae31b1e-0194-4814-9fb3-5feb0b56fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:18.476816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae31b1e-0194-4814-9fb3-5feb0b56fd3b None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.477262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae31b1e-0194-4814-9fb3-5feb0b56fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.478491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae31b1e-0194-4814-9fb3-5feb0b56fd3b None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/2dc70e207356497692776610f97a2925/roles/5fe956d1e23649e48d1c67402b297718` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.481583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae31b1e-0194-4814-9fb3-5feb0b56fd3b None admin] RBAC: Authorizing `identity:create_grant(project_id=01d335aab075477caa5c8e2d01f3ff8a, user_id=2dc70e207356497692776610f97a2925, role_id=5fe956d1e23649e48d1c67402b297718)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:18.483422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae31b1e-0194-4814-9fb3-5feb0b56fd3b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:18.512479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cbaf6-4daf-4d7b-b2e2-5eceb114bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:18.513407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbaf6-4daf-4d7b-b2e2-5eceb114bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.513689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbaf6-4daf-4d7b-b2e2-5eceb114bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.514002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbaf6-4daf-4d7b-b2e2-5eceb114bcd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.526932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cbaf6-4daf-4d7b-b2e2-5eceb114bcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f10cbaf6-4daf-4d7b-b2e2-5eceb114bcd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:18.531965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:18.542142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 81/160] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:18.542984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12667e6-01d2-451e-b027-4356a8a4a623 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.543691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12667e6-01d2-451e-b027-4356a8a4a623 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.543691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12667e6-01d2-451e-b027-4356a8a4a623 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.543691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 82/161] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:18.543691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12667e6-01d2-451e-b027-4356a8a4a623 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:18.558989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:18.568465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 80/162] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:18 2022] PUT /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/users/2dc70e207356497692776610f97a2925/roles/5fe956d1e23649e48d1c67402b297718 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:18.570122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c921-1e88-42bc-8fa2-2864936cea02 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.570628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c921-1e88-42bc-8fa2-2864936cea02 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.571084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7c921-1e88-42bc-8fa2-2864936cea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.592786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7ff7c921-1e88-42bc-8fa2-2864936cea02 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:18.594528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7ff7c921-1e88-42bc-8fa2-2864936cea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:18.677329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12667e6-01d2-451e-b027-4356a8a4a623 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:18.684774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 81/163] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:18.686082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7c921-1e88-42bc-8fa2-2864936cea02 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:18.722439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:18.723414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.723702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.723982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.724660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:18.724964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:18.726510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:18.739793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 83/164] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:18.747721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:18.854149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7c921-1e88-42bc-8fa2-2864936cea02 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:18.874958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:18.876203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:18.913911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:18.914562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.914836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.915163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.919254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd473ffe-c7de-4bf7-9a7e-99f300913ca8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:18.940358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:18.945185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:18.946096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:18.947126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 82/165] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:18.954364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:18.982260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:18.984201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:18.984737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:18.985216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] PATH_INFO: `/v3/users/1309f51714bc425caa70be3d6c622b5e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:18.986858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] RBAC: Authorizing `identity:get_user(user_id=1309f51714bc425caa70be3d6c622b5e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:18.988519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:18.990830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 84/166] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:18 2022] GET /identity/v3/users/1309f51714bc425caa70be3d6c622b5e => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:18.997180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:19.085685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89727-f383-4ced-9446-a19c7806d2d9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:19.105932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d202885-676b-4dfd-b943-de6bd8644786 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:19.143838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:19.145567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:19.146607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:19.147233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:19.149047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:19.150137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:19.152206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:19.155854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:19.156736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:19.157217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:19.158376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:19.169010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 83/167] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:19.175326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:19.178336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:19.234539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:19.287659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:19.289125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:19.349360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a2eff-8b6e-469b-b089-3f50f3760a7c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:19.419575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:19.420233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:19.420519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:19.420794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:19.444510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:19.451183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:19.452082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:19.452957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:19.457427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 84/168] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:19.458687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:19.478963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 85/169] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:19.484805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:19.602323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:19.659684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:19.678308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23d525-0075-498f-b5a2-3e7b10e4c585 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:19.727854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f78f99-cad8-4738-90e4-dae6eceff216 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:19.758619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:19.759803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:19.760081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:19.760347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:19.761511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:19.763145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:19.764796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 85/170] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:19 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:19.765610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:19.799412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:19.800078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:19.800363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:19.800636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:19.801306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:19.801609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:19.803009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:19.821023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 86/171] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:19.822229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:20.008821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657654-2d35-45c9-8e52-2ccc69d85899 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:20.041434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac83cb-7c7a-44d0-8043-402216f140e2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:20.043037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:20.066472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:20.067117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:20.073588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:20.073588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:20.073588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:20.073588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:20.073588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 86/172] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:19 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:20.073588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:20.111420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:20.134632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:20.135258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:20.135540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:20.135814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:20.262116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:20.263488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8751-b530-475b-b26b-a1b6ddd07180 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:20.263598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:20.323802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:20.324968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:20.325457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:20.325955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] PATH_INFO: `/v3/users/3799900f832343e982b92b4fa868b5bf` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:20.328937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] RBAC: Authorizing `identity:get_user(user_id=3799900f832343e982b92b4fa868b5bf)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:20.330616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:20.333386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 87/173] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:20 2022] GET /identity/v3/users/3799900f832343e982b92b4fa868b5bf => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:20.334442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:20.486177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:20.494420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a484fdf-63d5-4762-8489-b885cf1c1d81 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:20.512965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 87/174] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:20.513601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:20.519979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:20.553278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:20.553949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:20.554237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:20.554517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:20.555256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=1309f51714bc425caa70be3d6c622b5e) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:20.555573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:20.557068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:20.563687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 88/175] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:20 2022] GET /identity/v3/role_assignments?user.id=1309f51714bc425caa70be3d6c622b5e&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:20.570847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:20.750053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f76f-24be-4e34-8297-1ccd096b5f44 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:20.763337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99951a0e-0f84-45ab-a77d-ae10f6d23808 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:20.811967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:20.812600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:20.812885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:20.813161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:20.830564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:20.831236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:20.831791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:20.832072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:20.833305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:20.834850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:20.838191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 89/176] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:20 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:20.843124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:20.890199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:20.927720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:20.929200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:20.935385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:21.026439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5832-b8f7-4a68-a9d7-57e3467f6ca8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:21.078275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 88/177] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:21.084694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:21.103103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:21.103786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.104154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.104415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.105153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] RBAC: Adding query filter params (role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=3799900f832343e982b92b4fa868b5bf) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:21.105557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:21.107063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:21.117360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 90/178] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:20 2022] GET /identity/v3/role_assignments?user.id=3799900f832343e982b92b4fa868b5bf&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=4eba1d0edde84f6da82050340e36f845 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:21.229714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016497d-b1fb-4ca7-b54c-752b148f28a2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:21.231536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:21.273371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693b1ba-5862-4631-9c00-92171118c915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:21.274056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693b1ba-5862-4631-9c00-92171118c915 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.274478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693b1ba-5862-4631-9c00-92171118c915 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.275186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693b1ba-5862-4631-9c00-92171118c915 None admin] PATH_INFO: `/v3/projects/12998201febe4f6592b926d6e4a5fb3b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.276375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693b1ba-5862-4631-9c00-92171118c915 None admin] RBAC: Authorizing `identity:get_project(project_id=12998201febe4f6592b926d6e4a5fb3b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:21.277933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693b1ba-5862-4631-9c00-92171118c915 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:21.281967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 89/179] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:21 2022] GET /identity/v3/projects/12998201febe4f6592b926d6e4a5fb3b => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:21.285950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:21.424854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:21.435466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63003-770c-4b69-aa86-377ebc15cf31 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:21.509733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824b955-80af-4cc7-8021-d01ad9b881c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:21.510412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b955-80af-4cc7-8021-d01ad9b881c2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.510689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b955-80af-4cc7-8021-d01ad9b881c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.510967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b955-80af-4cc7-8021-d01ad9b881c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.511706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b955-80af-4cc7-8021-d01ad9b881c2 None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=12998201febe4f6592b926d6e4a5fb3b, user.id=3799900f832343e982b92b4fa868b5bf) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:21.512013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b955-80af-4cc7-8021-d01ad9b881c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:21.513542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824b955-80af-4cc7-8021-d01ad9b881c2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:21.522591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 91/180] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:21 2022] GET /identity/v3/role_assignments?user.id=3799900f832343e982b92b4fa868b5bf&scope.project.id=12998201febe4f6592b926d6e4a5fb3b&role.id=c2fb856e141d464e9be4bbf269169309 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:21.684754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66faca2-c1cd-45dc-a9fa-d2a17d9574b8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.685144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66faca2-c1cd-45dc-a9fa-d2a17d9574b8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.685318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66faca2-c1cd-45dc-a9fa-d2a17d9574b8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.686671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 90/181] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:21.692125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936a098-ec39-407a-885e-bc79e2c88ad2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.692416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936a098-ec39-407a-885e-bc79e2c88ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.692696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936a098-ec39-407a-885e-bc79e2c88ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.718836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8936a098-ec39-407a-885e-bc79e2c88ad2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:21.719508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8936a098-ec39-407a-885e-bc79e2c88ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:21.807355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 92/182] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:21.902617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3bb2-05ec-4e89-b772-ccf628c89166 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.902934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3bb2-05ec-4e89-b772-ccf628c89166 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.903172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a3bb2-05ec-4e89-b772-ccf628c89166 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.904636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 91/183] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:21.910688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe142-ff17-4810-a20e-fc911530445a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.911284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe142-ff17-4810-a20e-fc911530445a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.911751 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe142-ff17-4810-a20e-fc911530445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.934053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-584fe142-ff17-4810-a20e-fc911530445a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:21.935308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-584fe142-ff17-4810-a20e-fc911530445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:21.947607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49cdd9-9b46-449d-8dda-9fccc154a99a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.947887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49cdd9-9b46-449d-8dda-9fccc154a99a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.948152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49cdd9-9b46-449d-8dda-9fccc154a99a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.949632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 92/184] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:21.954730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb75db-1f03-4e41-a19a-628c042d4074 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:21.955010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb75db-1f03-4e41-a19a-628c042d4074 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:21.955281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb75db-1f03-4e41-a19a-628c042d4074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:21.981437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0bcb75db-1f03-4e41-a19a-628c042d4074 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:21.982661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0bcb75db-1f03-4e41-a19a-628c042d4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:22.033425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 93/185] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:22.034825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567180-a319-4ff7-969a-8879d240541e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.035116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567180-a319-4ff7-969a-8879d240541e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.035448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567180-a319-4ff7-969a-8879d240541e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.036877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 94/186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:22.043037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92034-bc39-4f15-9f12-60b8f1b2d14d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.043317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92034-bc39-4f15-9f12-60b8f1b2d14d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.043594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92034-bc39-4f15-9f12-60b8f1b2d14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.066788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dfa92034-bc39-4f15-9f12-60b8f1b2d14d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:22.068428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dfa92034-bc39-4f15-9f12-60b8f1b2d14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:22.073932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 93/187] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:22.079757 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.139626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 95/188] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:22.143942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb75db-1f03-4e41-a19a-628c042d4074 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.247286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.250161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb75db-1f03-4e41-a19a-628c042d4074 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.285630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.286295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.286580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.286858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.297737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:22.302577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:22.303450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:22.304233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 94/189] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:22.310948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92034-bc39-4f15-9f12-60b8f1b2d14d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.335972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.417872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92034-bc39-4f15-9f12-60b8f1b2d14d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.444762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc9ba2-00d0-4d6e-ab57-1990af71461d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.457786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.458401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.458682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.458957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.459619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:22.459928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:22.461355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:22.470085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 96/190] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:22.470878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.480096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.481071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.481702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.482021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.482295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.492570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:22.498736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:22.499596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:22.500457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 95/191] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:22.501314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.523476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.576228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed07df4-8c55-41e1-9b29-7a346ae7c891 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.599862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a289e6-a22b-4f0e-98d7-9327fc56ec45 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.610760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.611406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.611696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.611974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.613110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:22.614594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:22.616172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 97/192] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:22.616940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.636999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.637626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.637946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.638218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.648109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:22.652842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:22.653920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 96/193] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:22.654727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.692445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.717881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e96bd-a468-4dd2-986e-e8514ed6459a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.737731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.751416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.751983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.752261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.752531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] PATH_INFO: `/v3/users/3c4e5470b7b94fae8470a61d35651b62` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.756511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9258157-98ec-41ae-9fd1-ec603d7fba72 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.766308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] RBAC: Authorizing `identity:get_user(user_id=3c4e5470b7b94fae8470a61d35651b62)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:22.767755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:22.769364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 98/194] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/users/3c4e5470b7b94fae8470a61d35651b62 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:22.769364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.795385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.795987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.796268 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.796539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.797192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:22.797495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:22.798916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:22.807205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 97/195] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:22.808006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.868733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e72846-68b1-44ca-98b6-fa344aa60faa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.897102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:22.902135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.902748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.906760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.906760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.906760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:22.906760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:22.909970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac84d81-6790-4d59-ab2b-d0fe21a097d0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:22.944032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:22.944637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:22.944919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:22.945192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:22.945884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:22.946289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:22.947698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:22.955448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 98/196] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:22.956224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:22.959826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.015551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 99/197] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:50:22 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:23.016413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.059407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422048-16a6-4fba-b3ca-06241ec27f5d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:23.102298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:23.103483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:23.103765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:23.104198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:23.134755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24994e47-1053-4743-98df-a92654b53ee9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:23.175199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:23.175851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:23.176134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:23.176411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] PATH_INFO: `/v3/users/3c4e5470b7b94fae8470a61d35651b62` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:23.177589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] RBAC: Authorizing `identity:get_user(user_id=3c4e5470b7b94fae8470a61d35651b62)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:23.179108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:23.181268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 100/198] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/users/3c4e5470b7b94fae8470a61d35651b62 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:23.182072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.183554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:23.185148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:23.188010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.253361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.300178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 99/199] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:23.302567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.306736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8ff95-c729-46da-be56-50357a3ce22f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:23.347367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:23.348000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:23.348275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:23.348549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] PATH_INFO: `/v3/users/2dc70e207356497692776610f97a2925` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:23.349689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] RBAC: Authorizing `identity:get_user(user_id=2dc70e207356497692776610f97a2925)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:23.351315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:23.353304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 101/200] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/users/2dc70e207356497692776610f97a2925 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:23.354136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.426527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727657c-c502-4d40-9c93-b09016229df0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:23.430163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.472393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:23.473116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:23.473404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:23.473680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:23.494397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f01776-c5e9-486f-a7a9-9aa56d5f8b32 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:23.526215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.540146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38439139-9394-4c9c-b433-0e735145703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:23.541205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439139-9394-4c9c-b433-0e735145703b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:23.541484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439139-9394-4c9c-b433-0e735145703b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:23.541770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38439139-9394-4c9c-b433-0e735145703b None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:23.545371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38439139-9394-4c9c-b433-0e735145703b None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:23.545684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38439139-9394-4c9c-b433-0e735145703b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:23.548033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 102/201] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:23.548805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38439139-9394-4c9c-b433-0e735145703b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.557892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:23.559403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:23.671454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38439139-9394-4c9c-b433-0e735145703b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:23.682173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 100/202] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:23.683204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.686795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.714084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:23.714730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:23.715016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:23.715296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:23.786417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.798991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:23.800811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:23.804369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062fc0a-a021-4b58-b719-0a1d9798c900 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:23.840998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:23.841529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:23.841856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:23.842112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:23.842835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=3c4e5470b7b94fae8470a61d35651b62) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:23.843144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:23.844600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:23.850667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 101/203] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/role_assignments?user.id=3c4e5470b7b94fae8470a61d35651b62&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:23.851255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.924411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 103/204] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:23.930124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:23.941688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:23.989076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee50a8-a30a-44dc-9470-89919e3ad305 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:24.034915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:24.035936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:24.036395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:24.036880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:24.038350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:24.040991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:24.043390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 102/205] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:24.054996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:24.130147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:24.137420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576a027-a971-4777-b518-0d214d6e255a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:24.213195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:24.213859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:24.214141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:24.214418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:24.215882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:24.217322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:24.228282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 104/206] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:23 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:24.242433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:24.267503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a846259-cb0c-4640-bb7a-dad1fbc396d5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:24.327885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccc815-3a5a-4d10-b03d-2147cd9d1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:24.328495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccc815-3a5a-4d10-b03d-2147cd9d1371 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:24.328773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccc815-3a5a-4d10-b03d-2147cd9d1371 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:24.329046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccc815-3a5a-4d10-b03d-2147cd9d1371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:24.329785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccc815-3a5a-4d10-b03d-2147cd9d1371 None admin] RBAC: Adding query filter params (role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=3c4e5470b7b94fae8470a61d35651b62) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:24.330099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccc815-3a5a-4d10-b03d-2147cd9d1371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:24.331800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccc815-3a5a-4d10-b03d-2147cd9d1371 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:24.338536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:24.344490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 103/207] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:24 2022] GET /identity/v3/role_assignments?user.id=3c4e5470b7b94fae8470a61d35651b62&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=4eba1d0edde84f6da82050340e36f845 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:24.429386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9554d2-de17-42e6-ad89-02efc06e4b48 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:24.523670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f3cf6-de15-495e-8b7b-f110620408ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:24.524567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f3cf6-de15-495e-8b7b-f110620408ce None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:24.524843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f3cf6-de15-495e-8b7b-f110620408ce None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:24.525350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f3cf6-de15-495e-8b7b-f110620408ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:24.526051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f3cf6-de15-495e-8b7b-f110620408ce None admin] RBAC: Adding query filter params (role.id=5fe956d1e23649e48d1c67402b297718, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a, user.id=2dc70e207356497692776610f97a2925) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:24.526366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f3cf6-de15-495e-8b7b-f110620408ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:24.527827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f3cf6-de15-495e-8b7b-f110620408ce None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:24.537947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 105/208] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:24 2022] GET /identity/v3/role_assignments?user.id=2dc70e207356497692776610f97a2925&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=5fe956d1e23649e48d1c67402b297718 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:25.421329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f82ec7-c5ab-43db-a844-dd12ba843999 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:25.421865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f82ec7-c5ab-43db-a844-dd12ba843999 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:25.421971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f82ec7-c5ab-43db-a844-dd12ba843999 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:25.423478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 104/209] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:25.429052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d170c-3209-4c7a-aa99-7b7071198e46 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:25.429442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d170c-3209-4c7a-aa99-7b7071198e46 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:25.429614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d170c-3209-4c7a-aa99-7b7071198e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:25.449411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-849d170c-3209-4c7a-aa99-7b7071198e46 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:25.450677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-849d170c-3209-4c7a-aa99-7b7071198e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:25.469676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:25.522288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 106/210] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:25.795642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1988e3-494a-4344-9b8f-82ee8f134760 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:25.795986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1988e3-494a-4344-9b8f-82ee8f134760 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:25.796236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1988e3-494a-4344-9b8f-82ee8f134760 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:25.797799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 105/211] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:25.800991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d170c-3209-4c7a-aa99-7b7071198e46 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:25.802976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3334-41a3-40bc-bf97-a58d98c6f64f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:25.803259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3334-41a3-40bc-bf97-a58d98c6f64f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:25.803536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3334-41a3-40bc-bf97-a58d98c6f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:25.822156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d72b3334-41a3-40bc-bf97-a58d98c6f64f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:25.823346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d72b3334-41a3-40bc-bf97-a58d98c6f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:25.892877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 106/212] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:25.919341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d170c-3209-4c7a-aa99-7b7071198e46 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:25.954523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:25.955148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:25.955426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:25.955697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:25.966890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:25.971681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:25.972534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:25.973342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 107/213] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:25.978783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b3334-41a3-40bc-bf97-a58d98c6f64f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:26.085059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b3334-41a3-40bc-bf97-a58d98c6f64f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:26.118997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:26.122409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:26.122991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.123269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.123543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.124203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:26.124504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:26.125901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:26.134303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 107/214] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:26.151678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:26.157455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:26.164910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:26.259800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc0f6-0150-44a1-8551-8771e2d8dfcf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:26.271832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56768b1-3f00-4b69-b1cc-d7861c99dec6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:26.297855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe7562-8e26-4c14-85dd-ee48e4c49b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:26.299001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7562-8e26-4c14-85dd-ee48e4c49b98 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.299424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7562-8e26-4c14-85dd-ee48e4c49b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.299849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7562-8e26-4c14-85dd-ee48e4c49b98 None admin] PATH_INFO: `/v3/users/ea1c06f47efe46208967d2ca7d8d53c5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.307201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba8a10-c388-42bf-b205-e114d923ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:26.307830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba8a10-c388-42bf-b205-e114d923ff01 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.308111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba8a10-c388-42bf-b205-e114d923ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.308381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba8a10-c388-42bf-b205-e114d923ff01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.309510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba8a10-c388-42bf-b205-e114d923ff01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:26.311004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba8a10-c388-42bf-b205-e114d923ff01 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:26.312568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 108/215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:26.313672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb5dc-ad2d-430f-a6d9-998abd99828b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.313975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb5dc-ad2d-430f-a6d9-998abd99828b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.314246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb5dc-ad2d-430f-a6d9-998abd99828b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.315413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 109/216] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:26.317799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb5dc-ad2d-430f-a6d9-998abd99828b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:26.324739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7562-8e26-4c14-85dd-ee48e4c49b98 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1c06f47efe46208967d2ca7d8d53c5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:26.326252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe7562-8e26-4c14-85dd-ee48e4c49b98 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:26.328332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 108/217] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:26 2022] GET /identity/v3/users/ea1c06f47efe46208967d2ca7d8d53c5 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:26.329363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755be3d8-3e02-4150-8be9-c1348b50b572 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.329643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755be3d8-3e02-4150-8be9-c1348b50b572 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.329939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755be3d8-3e02-4150-8be9-c1348b50b572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.349270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-755be3d8-3e02-4150-8be9-c1348b50b572 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:26.350619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-755be3d8-3e02-4150-8be9-c1348b50b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:26.382991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:26.425082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 109/218] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:26.425938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb5dc-ad2d-430f-a6d9-998abd99828b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:26.427472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755be3d8-3e02-4150-8be9-c1348b50b572 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:26.435215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:26.464578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:26.465227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.465515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.465813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.466472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:26.468109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:26.551668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755be3d8-3e02-4150-8be9-c1348b50b572 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:26.560412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 110/219] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:50:26 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:26.599632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78b6e2-7aae-459a-9d86-607e8d664947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:26.600667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b6e2-7aae-459a-9d86-607e8d664947 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.601149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b6e2-7aae-459a-9d86-607e8d664947 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.601632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78b6e2-7aae-459a-9d86-607e8d664947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.690959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78b6e2-7aae-459a-9d86-607e8d664947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:26.692917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78b6e2-7aae-459a-9d86-607e8d664947 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:26.695559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:26.705712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:26.830053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 110/220] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:26.831453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041123-eccc-4e23-8747-f0b189a7d17d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.832044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041123-eccc-4e23-8747-f0b189a7d17d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.832325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87041123-eccc-4e23-8747-f0b189a7d17d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.834263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 111/221] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:26.838938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87041123-eccc-4e23-8747-f0b189a7d17d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:26.856629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad092-a558-421c-8c7f-3dd38a498413 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:26.876776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:26.901156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f46ec-38c2-4008-9ec8-a2faeedf54f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:26.901903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f46ec-38c2-4008-9ec8-a2faeedf54f6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.902196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f46ec-38c2-4008-9ec8-a2faeedf54f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.902517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f46ec-38c2-4008-9ec8-a2faeedf54f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.916441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f46ec-38c2-4008-9ec8-a2faeedf54f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-8a1f46ec-38c2-4008-9ec8-a2faeedf54f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:26.922918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:26.923800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 111/222] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:26.925145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0d25a-0ddf-4396-ae8d-8d79d4a7fe21 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:26.925895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0d25a-0ddf-4396-ae8d-8d79d4a7fe21 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:26.925895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0d25a-0ddf-4396-ae8d-8d79d4a7fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:26.947370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cae0d25a-0ddf-4396-ae8d-8d79d4a7fe21 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:26.949022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cae0d25a-0ddf-4396-ae8d-8d79d4a7fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:26.972471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87041123-eccc-4e23-8747-f0b189a7d17d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:26.975802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:27.011978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:27.012622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:27.012907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:27.013182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:27.014487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:27.015948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:27.017587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 112/223] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:26 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:27.022035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:27.042305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 112/224] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:27.043331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0d25a-0ddf-4396-ae8d-8d79d4a7fe21 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:27.152146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947a886-123b-410e-a958-0980f7e0e140 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:27.184938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0d25a-0ddf-4396-ae8d-8d79d4a7fe21 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:27.202712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:27.239055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:27.239682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:27.239965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:27.240246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:27.240918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:27.241225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:27.242088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:27.242638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:27.242743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:27.243139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:27.243527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:27.244325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=ea1c06f47efe46208967d2ca7d8d53c5) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:27.244808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:27.246509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:27.252499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 113/225] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:27 2022] GET /identity/v3/role_assignments?user.id=ea1c06f47efe46208967d2ca7d8d53c5&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=c2fb856e141d464e9be4bbf269169309 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:27.268402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 113/226] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:27.273810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:27.372262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:27.421075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:27.466160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3bba-5f7d-430c-88a8-6ba48b9f9080 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:27.534056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:27.534711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:27.534994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:27.535262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] PATH_INFO: `/v3/users/3c4e5470b7b94fae8470a61d35651b62` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:27.537161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] RBAC: Authorizing `identity:get_user(user_id=3c4e5470b7b94fae8470a61d35651b62)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:27.538642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:27.541071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 114/227] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:27 2022] GET /identity/v3/users/3c4e5470b7b94fae8470a61d35651b62 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:27.549178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:27.558984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07816490-ee1e-439b-a09c-a09ff54ef968 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:27.592187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:27.607872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:27.608789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:27.609073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:27.609345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:27.624344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:27.629889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:27.630773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:27.631969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 114/228] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:27.637828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:27.710816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874a9b-2a0c-4eb0-a3f3-5cf415656627 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:27.781673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:27.782385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:27.782663 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:27.782928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:27.785562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:27.787044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:27.789635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 115/229] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:27 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:27.797114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:27.801502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:27.818343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880805a8-7e32-4624-b157-c9c1a49d6a01 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:27.894037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:27.894708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:27.894989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:27.895260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:27.895928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:27.896229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:27.897612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:27.910029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 115/230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:27.917039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:28.000805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a39d0f-3831-4dca-8be0-a5ac18b83f75 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:28.010722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:28.048059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:28.048724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:28.049003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:28.049276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/3c4e5470b7b94fae8470a61d35651b62/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:28.051442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] RBAC: Authorizing `identity:create_grant(project_id=09cfeb2bb213465c9343a0940f6a400c, user_id=3c4e5470b7b94fae8470a61d35651b62, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:28.052934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:28.089355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257af8-9ed8-4ed4-8abe-27b46f2eef34 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:28.127102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:28.127797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:28.128076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:28.128351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] PATH_INFO: `/v3/users/3c4e5470b7b94fae8470a61d35651b62` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:28.133278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] RBAC: Authorizing `identity:get_user(user_id=3c4e5470b7b94fae8470a61d35651b62)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:28.135399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:28.137224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 116/231] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:27 2022] GET /identity/v3/users/3c4e5470b7b94fae8470a61d35651b62 => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:28.139867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 116/232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:27 2022] PUT /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/3c4e5470b7b94fae8470a61d35651b62/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:28.145100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:28.187001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:28.275839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cb4f3-e934-48c6-9be5-def6c629840d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:28.314642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d36b8-6ac5-4393-95fa-ff97033d4e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:28.315348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d36b8-6ac5-4393-95fa-ff97033d4e13 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:28.315628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d36b8-6ac5-4393-95fa-ff97033d4e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:28.315902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d36b8-6ac5-4393-95fa-ff97033d4e13 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:28.317142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d36b8-6ac5-4393-95fa-ff97033d4e13 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:28.318716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d36b8-6ac5-4393-95fa-ff97033d4e13 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:28.320625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 117/233] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:28 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:28.327479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:28.436810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142c293-a4e6-45b0-9081-12ddb05efafd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:28.472941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1660d-beb4-43bc-b1b9-889d6ba4b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:28.473614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1660d-beb4-43bc-b1b9-889d6ba4b378 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:28.473954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1660d-beb4-43bc-b1b9-889d6ba4b378 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:28.474187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1660d-beb4-43bc-b1b9-889d6ba4b378 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/3c4e5470b7b94fae8470a61d35651b62/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:28.476459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1660d-beb4-43bc-b1b9-889d6ba4b378 None admin] RBAC: Authorizing `identity:create_grant(project_id=09cfeb2bb213465c9343a0940f6a400c, user_id=3c4e5470b7b94fae8470a61d35651b62, role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:28.478985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1660d-beb4-43bc-b1b9-889d6ba4b378 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:28.578864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:28 2022] PUT /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/3c4e5470b7b94fae8470a61d35651b62/roles/4eba1d0edde84f6da82050340e36f845 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:29.090707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41537f0-e60b-4c74-9fe3-1cf99cc1d825 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:29.091249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41537f0-e60b-4c74-9fe3-1cf99cc1d825 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:29.091249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41537f0-e60b-4c74-9fe3-1cf99cc1d825 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:29.092817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 118/235] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:29.098274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895ffe-8866-46aa-a04f-b98e962f624e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:29.098561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895ffe-8866-46aa-a04f-b98e962f624e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:29.098837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895ffe-8866-46aa-a04f-b98e962f624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:29.124392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c1895ffe-8866-46aa-a04f-b98e962f624e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:29.125577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c1895ffe-8866-46aa-a04f-b98e962f624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:29.156844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:29.220081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 118/236] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:29.504280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52010-ab94-4a57-9550-a7c1096a6577 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:29.504564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52010-ab94-4a57-9550-a7c1096a6577 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:29.505045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52010-ab94-4a57-9550-a7c1096a6577 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:29.506844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 119/237] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:29.512043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d05c5-2bdc-4793-b7d5-907420edee8d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:29.512865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d05c5-2bdc-4793-b7d5-907420edee8d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:29.513316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d05c5-2bdc-4793-b7d5-907420edee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:29.534758 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ed4d05c5-2bdc-4793-b7d5-907420edee8d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:29.536213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ed4d05c5-2bdc-4793-b7d5-907420edee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:29.596907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c52010-ab94-4a57-9550-a7c1096a6577 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:29.622277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 119/238] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:29.707837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:29.726766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c52010-ab94-4a57-9550-a7c1096a6577 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:29.779153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:29.779710 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:29.779992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:29.780273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:29.792881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:29.798206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:29.799062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:29.799842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:29.807773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 120/239] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:29.813601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d05c5-2bdc-4793-b7d5-907420edee8d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:29.926857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:29.990137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:30.011733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d05c5-2bdc-4793-b7d5-907420edee8d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.048954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cebf70-939f-441d-b61d-2e0dec7e8be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:30.049478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebf70-939f-441d-b61d-2e0dec7e8be3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.049782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebf70-939f-441d-b61d-2e0dec7e8be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.050073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cebf70-939f-441d-b61d-2e0dec7e8be3 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.050974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cebf70-939f-441d-b61d-2e0dec7e8be3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:30.051147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cebf70-939f-441d-b61d-2e0dec7e8be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:30.052552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cebf70-939f-441d-b61d-2e0dec7e8be3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:30.062387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 120/240] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:30.063608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f95da-03c6-46bd-ac99-e37f6b70fcdb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.063898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f95da-03c6-46bd-ac99-e37f6b70fcdb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.064172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f95da-03c6-46bd-ac99-e37f6b70fcdb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.065596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 121/241] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:30.067550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f95da-03c6-46bd-ac99-e37f6b70fcdb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:30.072399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0a16f-d06f-41ba-a9a5-9b0994d1d50e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.120009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3e64-29eb-467b-838a-df9bb78e6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:30.120622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3e64-29eb-467b-838a-df9bb78e6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.120906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3e64-29eb-467b-838a-df9bb78e6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.121714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3e64-29eb-467b-838a-df9bb78e6ad8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.122867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3e64-29eb-467b-838a-df9bb78e6ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:30.125231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3e64-29eb-467b-838a-df9bb78e6ad8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:30.127030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 121/242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:30.128172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351834-4bb1-4a43-84e7-80c2bd228bee None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.128452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351834-4bb1-4a43-84e7-80c2bd228bee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.128722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351834-4bb1-4a43-84e7-80c2bd228bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.157229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-96351834-4bb1-4a43-84e7-80c2bd228bee None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:30.158782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-96351834-4bb1-4a43-84e7-80c2bd228bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:30.177112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:30.207627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f95da-03c6-46bd-ac99-e37f6b70fcdb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.242033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 122/243] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:30.243540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351834-4bb1-4a43-84e7-80c2bd228bee None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:30.256508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:30.257145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.257427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.257698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] PATH_INFO: `/v3/users/7087e74ce73c4462984047039743d674` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.287131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] RBAC: Authorizing `identity:get_user(user_id=7087e74ce73c4462984047039743d674)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:30.288613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:30.293718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 122/244] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:30 2022] GET /identity/v3/users/7087e74ce73c4462984047039743d674 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:30.299459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:30.314751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:30.398502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351834-4bb1-4a43-84e7-80c2bd228bee None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.441823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078270-2438-45a9-8851-81661263798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:30.442449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078270-2438-45a9-8851-81661263798a None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.442768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078270-2438-45a9-8851-81661263798a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.443047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078270-2438-45a9-8851-81661263798a None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.443711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078270-2438-45a9-8851-81661263798a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:30.445174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078270-2438-45a9-8851-81661263798a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:30.495090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99b91-a5a7-4b2a-8635-654dc0aad809 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.520317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 123/245] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:50:30 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:30.540693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:30.541521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.541831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.542113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.607716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078270-2438-45a9-8851-81661263798a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:30.620001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:30.624611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:30.626208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:30.635582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:30.804232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078270-2438-45a9-8851-81661263798a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.813950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 123/246] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:30.820779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:30.844879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f25650-fe76-4c9b-8803-8e13e6443462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:30.845787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25650-fe76-4c9b-8803-8e13e6443462 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.846211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25650-fe76-4c9b-8803-8e13e6443462 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.846653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f25650-fe76-4c9b-8803-8e13e6443462 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.858138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f25650-fe76-4c9b-8803-8e13e6443462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e3f25650-fe76-4c9b-8803-8e13e6443462 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:30.863754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:30.864859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:30.865884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:30.871622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 124/247] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:30.871622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c542f-d09b-480e-b1e7-aa2a6751f3e0 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.871622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c542f-d09b-480e-b1e7-aa2a6751f3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.871622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c542f-d09b-480e-b1e7-aa2a6751f3e0 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.871622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 125/248] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:30.873851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c542f-d09b-480e-b1e7-aa2a6751f3e0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:30.940240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa84db-6eb6-4327-bd0a-5ebcf53bb281 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.945063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:30.950047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:30.986947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5988-c962-4dce-9520-d36b6e97adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:30.987592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5988-c962-4dce-9520-d36b6e97adbd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.987874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5988-c962-4dce-9520-d36b6e97adbd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.988149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5988-c962-4dce-9520-d36b6e97adbd None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:30.990499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5988-c962-4dce-9520-d36b6e97adbd None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:30.991852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c542f-d09b-480e-b1e7-aa2a6751f3e0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:30.991959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5988-c962-4dce-9520-d36b6e97adbd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:30.994734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 124/249] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:30 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:30.995687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012cad-7d7f-4a5b-a6ed-c432d94fe104 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:30.995966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012cad-7d7f-4a5b-a6ed-c432d94fe104 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:30.996236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012cad-7d7f-4a5b-a6ed-c432d94fe104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.020660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-33012cad-7d7f-4a5b-a6ed-c432d94fe104 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:31.022099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-33012cad-7d7f-4a5b-a6ed-c432d94fe104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:31.038085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:31.038707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.038988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.039261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.041157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:31.041474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:31.042961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:31.052022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 126/250] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:31.052694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:31.111417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 125/251] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:31.112661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012cad-7d7f-4a5b-a6ed-c432d94fe104 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:31.168993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7e1c-d779-4ff7-a070-f1ec50a12f77 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:31.196367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:31.205311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:31.205968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.211616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.211616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.211616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] RBAC: Adding query filter params (role.id=5fe956d1e23649e48d1c67402b297718, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=7087e74ce73c4462984047039743d674) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:31.211616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:31.211616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:31.215552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 127/252] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:31 2022] GET /identity/v3/role_assignments?user.id=7087e74ce73c4462984047039743d674&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=5fe956d1e23649e48d1c67402b297718 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:31.262453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012cad-7d7f-4a5b-a6ed-c432d94fe104 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:31.278671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:31.320040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:31.320754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.321124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.321522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] PATH_INFO: `/v3/users/ea1c06f47efe46208967d2ca7d8d53c5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.322799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] RBAC: Authorizing `identity:get_user(user_id=ea1c06f47efe46208967d2ca7d8d53c5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:31.324472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:31.326108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 126/253] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:31 2022] GET /identity/v3/users/ea1c06f47efe46208967d2ca7d8d53c5 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:31.332176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:31.459378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f42e8a-57ac-4beb-a6b4-c2d3d3ecbb62 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:31.499073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:31.499719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.500043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.500322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.501467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:31.502983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:31.504671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 128/254] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:31 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:31.510989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:31.635227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65cb88-ff67-492a-9cf8-be4e8129b01c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:31.676254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abcef-f673-42ea-ad6c-032ca2274e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:31.676952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abcef-f673-42ea-ad6c-032ca2274e91 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.677235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abcef-f673-42ea-ad6c-032ca2274e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.677519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abcef-f673-42ea-ad6c-032ca2274e91 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/ea1c06f47efe46208967d2ca7d8d53c5/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.679609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abcef-f673-42ea-ad6c-032ca2274e91 None admin] RBAC: Authorizing `identity:create_grant(project_id=09cfeb2bb213465c9343a0940f6a400c, user_id=ea1c06f47efe46208967d2ca7d8d53c5, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:31.681798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abcef-f673-42ea-ad6c-032ca2274e91 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:31.728037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:31.771386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 127/255] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:31 2022] PUT /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/ea1c06f47efe46208967d2ca7d8d53c5/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:31.793572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430642-bf07-4c11-8d90-76b807ee2e37 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.793911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430642-bf07-4c11-8d90-76b807ee2e37 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.794171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430642-bf07-4c11-8d90-76b807ee2e37 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.795677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 128/256] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:31.807001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab3159-14a4-42ac-a133-f9448831972b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.807316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab3159-14a4-42ac-a133-f9448831972b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.807558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab3159-14a4-42ac-a133-f9448831972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.832734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:31.842626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0cab3159-14a4-42ac-a133-f9448831972b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:31.843888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0cab3159-14a4-42ac-a133-f9448831972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:31.910143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:31.916645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd43ee5-12b3-4833-b2d9-61bae5e45d66 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:31.957327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:31.958005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:31.958292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:31.958570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:31.970855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:31.976116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:31.977006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:31.978795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:31.981874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 129/257] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:31.987422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:31.994653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 129/258] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:32.104152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963d9d-5f84-45e1-9e59-f92f5455175e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:32.122288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:32.139234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:32.139848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:32.140135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:32.140457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:32.141084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:32.141391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:32.142823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:32.156103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 130/259] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:32.158797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab3159-14a4-42ac-a133-f9448831972b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:32.280084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab3159-14a4-42ac-a133-f9448831972b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:32.281206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:32.341473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:32.342160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:32.342441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:32.342718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] PATH_INFO: `/v3/users/3c4e5470b7b94fae8470a61d35651b62` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:32.343888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] RBAC: Authorizing `identity:get_user(user_id=3c4e5470b7b94fae8470a61d35651b62)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:32.345342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:32.346976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 130/260] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:32 2022] GET /identity/v3/users/3c4e5470b7b94fae8470a61d35651b62 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:32.356927 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:32.434182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:32.525676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b2e3-dc95-402c-858a-10bcf09ccab7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:32.552488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e365-ae2d-41a2-8c96-c9888d62a94e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:32.588384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:32.588996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:32.589275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:32.589546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:32.611953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:32.612598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:32.612882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:32.613158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:32.642732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:32.647653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:32.648606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:32.649725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 131/261] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:32.656585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:32.662542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:32.664013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:32.696202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:32.728361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:32.783227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 131/262] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:32.791221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:32.884501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9cf70-a447-485e-970d-9c93dadd9c13 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:32.900171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a065-db3f-4240-91b0-028b1dc81082 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:32.932843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:32.939459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:32.940142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:32.940427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:32.940828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:32.941981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:32.943431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:32.945519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 132/263] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:32 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:32.951721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:32.978501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:32.979128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:32.979410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:32.979686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:32.980359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:32.980663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:32.982091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:32.997116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 132/264] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:33.002587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:33.062004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce106d-0ffd-49a0-bce3-c57eff085743 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:33.099232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:33.099906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:33.100189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:33.100463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:33.101190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=3c4e5470b7b94fae8470a61d35651b62) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:33.101497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:33.104100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:33.111043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 133/265] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:32 2022] GET /identity/v3/role_assignments?user.id=3c4e5470b7b94fae8470a61d35651b62&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:33.210618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb264-ffbb-4a27-a4d5-aceb331fb404 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:33.212823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:33.257263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:33.257948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:33.258233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:33.259214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] PATH_INFO: `/v3/users/3c4e5470b7b94fae8470a61d35651b62` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:33.266681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] RBAC: Authorizing `identity:get_user(user_id=3c4e5470b7b94fae8470a61d35651b62)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:33.268183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:33.270292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 133/266] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:33 2022] GET /identity/v3/users/3c4e5470b7b94fae8470a61d35651b62 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:33.276269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:33.373156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:33.419473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3ca8-91b0-4d6f-b028-69311afed969 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:33.460134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e02b-7415-4a29-84e9-7e04b85ce607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:33.460855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e02b-7415-4a29-84e9-7e04b85ce607 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:33.461089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e02b-7415-4a29-84e9-7e04b85ce607 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:33.461364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e02b-7415-4a29-84e9-7e04b85ce607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:33.551866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7e02b-7415-4a29-84e9-7e04b85ce607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:33.553327 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7e02b-7415-4a29-84e9-7e04b85ce607 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:33.628305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:33.683163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 134/267] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 15:50:33.688581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:33.809498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d33d8-86b8-432a-88eb-f07176688891 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:33.810149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d33d8-86b8-432a-88eb-f07176688891 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:33.810642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d33d8-86b8-432a-88eb-f07176688891 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:33.812430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 135/268] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:33.817751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24130287-b499-421c-9c08-339482c3f61d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:33.818316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24130287-b499-421c-9c08-339482c3f61d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:33.818779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24130287-b499-421c-9c08-339482c3f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:33.839441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-24130287-b499-421c-9c08-339482c3f61d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:33.840974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-24130287-b499-421c-9c08-339482c3f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:33.858877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596a809-d2c8-4a2b-83fb-dacdeb316951 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:33.917804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:33.919488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:33.920700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:33.922143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:33.925036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:33.928540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:33.930519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 134/269] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:33 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:33.936399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:33.970283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 136/270] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:34.001085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:34.086886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15852b25-9070-4ae7-afd9-9782e5ca2d80 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:34.121920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bb653-bfa2-4c6d-a714-e694f22059a9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.122545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bb653-bfa2-4c6d-a714-e694f22059a9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.123025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bb653-bfa2-4c6d-a714-e694f22059a9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.124617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 137/271] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:34.129552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076b9ac-0039-4965-b0ca-3e1109027fc3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.130093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076b9ac-0039-4965-b0ca-3e1109027fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.130559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076b9ac-0039-4965-b0ca-3e1109027fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.138952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:34.139720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.140126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.140537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.141368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] RBAC: Adding query filter params (role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=3c4e5470b7b94fae8470a61d35651b62) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:34.141848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:34.143449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:34.150095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 135/272] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:33 2022] GET /identity/v3/role_assignments?user.id=3c4e5470b7b94fae8470a61d35651b62&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=4eba1d0edde84f6da82050340e36f845 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:34.165612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f076b9ac-0039-4965-b0ca-3e1109027fc3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:34.167171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f076b9ac-0039-4965-b0ca-3e1109027fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:34.243732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 138/273] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:34.324572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:34.481704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224d6cb-1c3d-4d77-a65d-c3cd72cc9ad4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:34.483627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:34.523113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:34.523750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.524685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.524980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.526164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:34.527618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:34.529629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 136/274] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:34.534920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076b9ac-0039-4965-b0ca-3e1109027fc3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:34.566120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:34.594064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:34.654870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076b9ac-0039-4965-b0ca-3e1109027fc3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:34.702684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2085222-2490-4329-af85-732ed9d6717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:34.703307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085222-2490-4329-af85-732ed9d6717b None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.703574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085222-2490-4329-af85-732ed9d6717b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.703851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2085222-2490-4329-af85-732ed9d6717b None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.704533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2085222-2490-4329-af85-732ed9d6717b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:34.706009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2085222-2490-4329-af85-732ed9d6717b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:34.737838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3daf74-e5d9-438d-a4b1-97a784fc863c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:34.777634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:34.778111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.778400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.778807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.791929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:34.797078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:34.798145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:34.798965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:34.803293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 137/275] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:34.805907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:34.831184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 139/276] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:50:34 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:34.842166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:34.906990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469f8c-f9c2-4a64-9fae-8d620ef0dd4e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.907673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469f8c-f9c2-4a64-9fae-8d620ef0dd4e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.908038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469f8c-f9c2-4a64-9fae-8d620ef0dd4e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.913859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 140/277] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:34.916173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253104de-9936-445a-b9ce-be012aeb2d5c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.916755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253104de-9936-445a-b9ce-be012aeb2d5c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.917277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253104de-9936-445a-b9ce-be012aeb2d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.935231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4e9ef-c8c3-4a2c-92ba-cc38de67c6ef None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:34.940459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-253104de-9936-445a-b9ce-be012aeb2d5c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:34.941991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-253104de-9936-445a-b9ce-be012aeb2d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:34.974999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:34.976095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:34.976631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:34.977605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:34.979017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:34.979559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:34.981233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:34.991536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 138/278] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:34.999112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:35.036578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 141/279] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:35.043298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98689b2-32b3-4a30-a5ff-50768b6412e3 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.043684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98689b2-32b3-4a30-a5ff-50768b6412e3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.044045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98689b2-32b3-4a30-a5ff-50768b6412e3 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.045558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 142/280] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:35.050935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173ce9e-6941-45b3-a6f6-2233c16b1b4a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.051540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173ce9e-6941-45b3-a6f6-2233c16b1b4a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.051540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173ce9e-6941-45b3-a6f6-2233c16b1b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.076382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1173ce9e-6941-45b3-a6f6-2233c16b1b4a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:35.077557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1173ce9e-6941-45b3-a6f6-2233c16b1b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:35.079977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:35.104307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:35.114229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b462a-6811-4d44-a85e-4a96388e7ddb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:35.160681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 143/281] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:35.167702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:35.168597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.169026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.169471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] PATH_INFO: `/v3/users/c0cae103bc06422b802cc42084f041b2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.185639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] RBAC: Authorizing `identity:get_user(user_id=c0cae103bc06422b802cc42084f041b2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:35.187253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:35.189203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 139/282] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:34 2022] GET /identity/v3/users/c0cae103bc06422b802cc42084f041b2 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:35.196290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173ce9e-6941-45b3-a6f6-2233c16b1b4a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:35.304090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173ce9e-6941-45b3-a6f6-2233c16b1b4a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:35.334033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:35.350129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:35.350129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.350129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.350129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.350515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, user.id=c0cae103bc06422b802cc42084f041b2, scope.system=all) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:35.350515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:35.350515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:35.357032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 144/283] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Oct 3 15:50:35 2022] GET /identity/v3/role_assignments?user.id=c0cae103bc06422b802cc42084f041b2&scope.system=all&role.id=c2fb856e141d464e9be4bbf269169309 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:35.464691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:35.465634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5becf-d8aa-4ec9-a973-1f7c82d14c57 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:35.468300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:35.510851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:35.511663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.512050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.512425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.534309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:35.539841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:35.541033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:35.542082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:35.551145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 140/284] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:35.558993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:35.582328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:35.667103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2e07e-fd50-47dc-bc6b-733a36725c20 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:35.727776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:35.728507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.728732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.728911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.740217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881db3ee-a6c5-4e6a-8bf3-3f8859e1d864 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:35.749712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:35.764050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:35.764992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:35.765801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 145/285] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:35.771060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:35.795174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:35.796126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.796604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.798000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.798895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:35.800904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:35.802535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:35.820515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 141/286] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:35.826399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:35.883331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:35.929441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f3347-1287-40d5-82f3-135557cb9262 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:35.969406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:35.970394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:35.970896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:35.971390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:35.972248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:35.972748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:35.974529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:35.984877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 146/287] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:35.990441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:36.023621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:36.108672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247ece-ee45-479b-894f-cbfad81a0810 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:36.139739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616333e6-ecf2-4615-9930-ec1a68aef054 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:36.148002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:36.157478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:36.158203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:36.158832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:36.159246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] PATH_INFO: `/v3/users/7087e74ce73c4462984047039743d674` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:36.160619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] RBAC: Authorizing `identity:get_user(user_id=7087e74ce73c4462984047039743d674)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:36.162329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:36.164416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 147/288] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:35 2022] GET /identity/v3/users/7087e74ce73c4462984047039743d674 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:36.170690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:36.195907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:36.196875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:36.197311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:36.197740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] PATH_INFO: `/v3/users/ea1c06f47efe46208967d2ca7d8d53c5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:36.203004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1c06f47efe46208967d2ca7d8d53c5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:36.205691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:36.208120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 142/289] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:35 2022] GET /identity/v3/users/ea1c06f47efe46208967d2ca7d8d53c5 => generated 297 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:36.218832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:36.340971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58084237-e043-4247-a7ad-2a2ad8ff44bb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:36.350197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fee939-07e5-48b3-9061-c8ee73a65754 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:36.376164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:36.377117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:36.377705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:36.378205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:36.379638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:36.381422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:36.384038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 148/290] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:36 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:36.389589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:36.399160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:36.399160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:36.399160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:36.399160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:36.411559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:36.457463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:36.500440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985995-af4e-42b8-b58f-b7c61d03e0f1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:36.535885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:36.536736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:36.537120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:36.537496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/7087e74ce73c4462984047039743d674/roles/5fe956d1e23649e48d1c67402b297718` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:36.540182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] RBAC: Authorizing `identity:create_grant(project_id=09cfeb2bb213465c9343a0940f6a400c, user_id=7087e74ce73c4462984047039743d674, role_id=5fe956d1e23649e48d1c67402b297718)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:36.541818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:36.556437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:36.558224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:36.614896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 149/291] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:50:36 2022] PUT /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c/users/7087e74ce73c4462984047039743d674/roles/5fe956d1e23649e48d1c67402b297718 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:50:36.684663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 143/292] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:36.690331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:36.858190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9387bd-55e1-4818-9b60-a4278cf728da None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:36.881700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:36.895938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09538d4e-ffe2-4e3d-bc96-01d40dfc3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:36.896571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538d4e-ffe2-4e3d-bc96-01d40dfc3614 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:36.896852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538d4e-ffe2-4e3d-bc96-01d40dfc3614 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:36.897124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09538d4e-ffe2-4e3d-bc96-01d40dfc3614 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:36.899439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538d4e-ffe2-4e3d-bc96-01d40dfc3614 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:36.900354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09538d4e-ffe2-4e3d-bc96-01d40dfc3614 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:36.902288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 150/293] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:36 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:36.908008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:36.955137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:37.012072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ddf75-c32e-43f8-9aed-65864861a9ae None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:37.051410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0fced-1863-4d72-ad8d-6ccb3229c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:37.052025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0fced-1863-4d72-ad8d-6ccb3229c79e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:37.052304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0fced-1863-4d72-ad8d-6ccb3229c79e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:37.052575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0fced-1863-4d72-ad8d-6ccb3229c79e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:37.053295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0fced-1863-4d72-ad8d-6ccb3229c79e None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=ea1c06f47efe46208967d2ca7d8d53c5) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:37.053599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0fced-1863-4d72-ad8d-6ccb3229c79e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:37.055792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0fced-1863-4d72-ad8d-6ccb3229c79e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:37.062422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 144/294] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:36 2022] GET /identity/v3/role_assignments?user.id=ea1c06f47efe46208967d2ca7d8d53c5&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=c2fb856e141d464e9be4bbf269169309 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:37.618818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6497-537c-4a65-895b-77512b3d8ac1 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:37.619178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6497-537c-4a65-895b-77512b3d8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:37.619462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6497-537c-4a65-895b-77512b3d8ac1 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:37.620954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 151/295] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:37.626194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7a3a-e544-4317-8ad4-096445f7b1df None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:37.626722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7a3a-e544-4317-8ad4-096445f7b1df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:37.627188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7a3a-e544-4317-8ad4-096445f7b1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:37.650774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4bed7a3a-e544-4317-8ad4-096445f7b1df None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:37.652301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4bed7a3a-e544-4317-8ad4-096445f7b1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:37.684543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea0d8-46fb-46fa-9408-fc655b1e679b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:37.684841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea0d8-46fb-46fa-9408-fc655b1e679b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:37.685097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea0d8-46fb-46fa-9408-fc655b1e679b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:37.687434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 152/296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:37.693632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ebeed-fce9-4773-864d-9e61344a333a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:37.694245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ebeed-fce9-4773-864d-9e61344a333a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:37.694532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ebeed-fce9-4773-864d-9e61344a333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:37.718626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2f9ebeed-fce9-4773-864d-9e61344a333a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:37.719970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2f9ebeed-fce9-4773-864d-9e61344a333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:37.750300 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 145/297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:37.801490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 153/298] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:37.936011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d894d6-d6dd-4834-8ad4-c9bd6597e5fd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:37.936926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d894d6-d6dd-4834-8ad4-c9bd6597e5fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:37.937427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d894d6-d6dd-4834-8ad4-c9bd6597e5fd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:37.939252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 146/299] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:37.947435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ba8d0-49e4-4d14-b695-5c33acd2b1a6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:37.948293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ba8d0-49e4-4d14-b695-5c33acd2b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:37.948824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ba8d0-49e4-4d14-b695-5c33acd2b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:37.969094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b30ba8d0-49e4-4d14-b695-5c33acd2b1a6 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:37.970694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b30ba8d0-49e4-4d14-b695-5c33acd2b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:38.026084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d894d6-d6dd-4834-8ad4-c9bd6597e5fd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.046252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 154/300] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:38.064969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:38.100877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ba8d0-49e4-4d14-b695-5c33acd2b1a6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.139403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d894d6-d6dd-4834-8ad4-c9bd6597e5fd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.170807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:38.176057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.176851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.177197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.177553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.188125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:38.193058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:38.193976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:38.194836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 147/301] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:38.200238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.231864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ba8d0-49e4-4d14-b695-5c33acd2b1a6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.268057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.268889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.269262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.269667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.270997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:38.272544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:38.274506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 155/302] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:38.279970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.317002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:38.326165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7143d9e-1304-43c6-8eef-ca3076b37409 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.361083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.361682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.361995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.362262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.362925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:38.363229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:38.364620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:38.373532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 148/303] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:38.378731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.397520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d62cd-a4da-49bc-b645-28b49032654b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.415713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:38.434672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.435290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.435577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.435853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] PATH_INFO: `/v3/groups` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.436480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:38.437975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:38.486553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63845ca9-5a01-42f2-9a94-84d3669a7bb2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.504212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 156/304] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Oct 3 15:50:38 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:38.505294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.529068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.529902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.530196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.530471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.544994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:38.551478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:38.552443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:38.553235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:38.558649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 149/305] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:38.559755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.583096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:38.638343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eeb9c-03dd-4cee-a2b3-5d0a1139317a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.682041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.682700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.683226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.683508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] PATH_INFO: `/v3/users/a815f99fadfa469fbe2da0ac177df9aa` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.694467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c112c2-e5f5-454e-b618-534cbb86d33d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.700252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] RBAC: Authorizing `identity:get_user(user_id=a815f99fadfa469fbe2da0ac177df9aa)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:38.701730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:38.703416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 157/306] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/users/a815f99fadfa469fbe2da0ac177df9aa => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:38.709311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.740246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.740808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.741082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.741354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.742058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:38.742362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:38.745163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:38.754246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:38.756793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 150/307] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:38.764614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:38.831167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91278-52c8-466e-bb0c-e00ce6e1eab2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.872211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:38.873688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.874806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.875354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.875999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.877259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] RBAC: Adding query filter params (role.id=5fe956d1e23649e48d1c67402b297718, user.id=a815f99fadfa469fbe2da0ac177df9aa, scope.system=all) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:38.877876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:38.879408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:38.885351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 158/308] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/role_assignments?user.id=a815f99fadfa469fbe2da0ac177df9aa&scope.system=all&role.id=5fe956d1e23649e48d1c67402b297718 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:38.897794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfbe28-36fe-40fa-892e-acf125f04d3e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:38.938095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb7d40-954b-44b0-8909-2cd6e037b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:38.939536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb7d40-954b-44b0-8909-2cd6e037b0ef None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:38.940001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb7d40-954b-44b0-8909-2cd6e037b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:38.940457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb7d40-954b-44b0-8909-2cd6e037b0ef None admin] PATH_INFO: `/v3/users/c0cae103bc06422b802cc42084f041b2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:38.941982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb7d40-954b-44b0-8909-2cd6e037b0ef None admin] RBAC: Authorizing `identity:get_user(user_id=c0cae103bc06422b802cc42084f041b2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:38.943692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb7d40-954b-44b0-8909-2cd6e037b0ef None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:38.946138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 151/309] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:38 2022] GET /identity/v3/users/c0cae103bc06422b802cc42084f041b2 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:38.955091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:39.067490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:39.072668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f391538-80fd-4a56-9ccc-1dfa376e1b23 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:39.115791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3dbf1-8e0d-4770-ace2-198ed474fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:39.116463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3dbf1-8e0d-4770-ace2-198ed474fa01 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:39.116748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3dbf1-8e0d-4770-ace2-198ed474fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:39.117021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3dbf1-8e0d-4770-ace2-198ed474fa01 None admin] PATH_INFO: `/v3/system/users/c0cae103bc06422b802cc42084f041b2/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:39.119866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3dbf1-8e0d-4770-ace2-198ed474fa01 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0cae103bc06422b802cc42084f041b2, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:39.121257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3dbf1-8e0d-4770-ace2-198ed474fa01 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:39.218427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 159/310] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Oct 3 15:50:38 2022] PUT /identity/v3/system/users/c0cae103bc06422b802cc42084f041b2/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:39.296123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d561-3b4b-47bc-a3c9-d56394fd73fd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:39.296456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d561-3b4b-47bc-a3c9-d56394fd73fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:39.296681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340d561-3b4b-47bc-a3c9-d56394fd73fd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:39.298446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 152/311] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:39.304220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88a49-0423-45bd-a090-88e2e29d09b2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:39.304532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88a49-0423-45bd-a090-88e2e29d09b2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:39.304788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a88a49-0423-45bd-a090-88e2e29d09b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:39.325008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b5a88a49-0423-45bd-a090-88e2e29d09b2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:39.326168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b5a88a49-0423-45bd-a090-88e2e29d09b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:39.405147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 160/312] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:39.679371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340d561-3b4b-47bc-a3c9-d56394fd73fd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:39.797711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340d561-3b4b-47bc-a3c9-d56394fd73fd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:39.833604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:39.834271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:39.834555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:39.834831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:39.845706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:39.850552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:39.851424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:39.852871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 153/313] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:39.858056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a88a49-0423-45bd-a090-88e2e29d09b2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:39.950011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:39.958632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a88a49-0423-45bd-a090-88e2e29d09b2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:39.995141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:39.995761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:39.996049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:39.996385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:39.997065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:39.997370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:39.998780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:40.007566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 161/314] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:40.014845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:40.025075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:40.122661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9f89f-6d2c-41cc-af65-a115d2f51f1e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:40.157506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:40.158245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:40.158530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:40.158824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] PATH_INFO: `/v3/users/7087e74ce73c4462984047039743d674` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:40.160052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] RBAC: Authorizing `identity:get_user(user_id=7087e74ce73c4462984047039743d674)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:40.161544 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:40.163687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 154/315] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:40 2022] GET /identity/v3/users/7087e74ce73c4462984047039743d674 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:40.169604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:40.273572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf742d-9ba6-4b7c-b752-e6efbeb0da78 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:40.308644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:40.309292 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:40.309613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:40.309919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:40.338170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:40.387162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:40.388638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:40.491012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 162/316] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:40.496528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:40.573284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:40.601774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff399dcc-7528-4d68-a4c6-6c88b52415b0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:40.638275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e08e3-6b15-4456-992d-2a400144a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:40.638910 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e08e3-6b15-4456-992d-2a400144a356 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:40.639194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e08e3-6b15-4456-992d-2a400144a356 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:40.639473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e08e3-6b15-4456-992d-2a400144a356 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:40.640603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e08e3-6b15-4456-992d-2a400144a356 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:40.642087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e08e3-6b15-4456-992d-2a400144a356 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:40.643721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 155/317] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:40 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:40.650412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:40.708083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:40.755351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ce271-1caa-4973-8ebe-538a0691b8d5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:40.791689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad1c2-9deb-49ef-a328-54f49f4b86ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:40.792296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad1c2-9deb-49ef-a328-54f49f4b86ec None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:40.792579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad1c2-9deb-49ef-a328-54f49f4b86ec None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:40.792853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad1c2-9deb-49ef-a328-54f49f4b86ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:40.793578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad1c2-9deb-49ef-a328-54f49f4b86ec None admin] RBAC: Adding query filter params (role.id=5fe956d1e23649e48d1c67402b297718, scope.project.id=09cfeb2bb213465c9343a0940f6a400c, user.id=7087e74ce73c4462984047039743d674) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:40.793920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad1c2-9deb-49ef-a328-54f49f4b86ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:40.795357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad1c2-9deb-49ef-a328-54f49f4b86ec None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:40.801753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 163/318] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:50:40 2022] GET /identity/v3/role_assignments?user.id=7087e74ce73c4462984047039743d674&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=5fe956d1e23649e48d1c67402b297718 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:40.963326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baff9-664e-4306-8e6f-4505a7c00ae7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:40.963662 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baff9-664e-4306-8e6f-4505a7c00ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:40.963891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baff9-664e-4306-8e6f-4505a7c00ae7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:40.965530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 156/319] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:40.971163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52acea-62d0-4116-af30-f3ad4bbc4190 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:40.971644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52acea-62d0-4116-af30-f3ad4bbc4190 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:40.971717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52acea-62d0-4116-af30-f3ad4bbc4190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:40.991134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4a52acea-62d0-4116-af30-f3ad4bbc4190 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:40.992328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4a52acea-62d0-4116-af30-f3ad4bbc4190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:41.074510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 164/320] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:41.156740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804fbd-da6f-4ca8-a310-5d9e6740a12a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.157269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804fbd-da6f-4ca8-a310-5d9e6740a12a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.157269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804fbd-da6f-4ca8-a310-5d9e6740a12a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.158953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 157/321] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:41.163807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86da99-4cb1-4c0f-abbe-16441422fadb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.164097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86da99-4cb1-4c0f-abbe-16441422fadb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.164424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86da99-4cb1-4c0f-abbe-16441422fadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.182693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6d86da99-4cb1-4c0f-abbe-16441422fadb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:41.183855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6d86da99-4cb1-4c0f-abbe-16441422fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:41.229564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:41.252358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 165/322] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:41.345951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804fbd-da6f-4ca8-a310-5d9e6740a12a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:41.455792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804fbd-da6f-4ca8-a310-5d9e6740a12a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:41.490307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725371-6dc9-49c1-bc61-ecdc3d8df6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:41.490853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725371-6dc9-49c1-bc61-ecdc3d8df6ff None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.491130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725371-6dc9-49c1-bc61-ecdc3d8df6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.491398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725371-6dc9-49c1-bc61-ecdc3d8df6ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.492500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725371-6dc9-49c1-bc61-ecdc3d8df6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:41.493974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725371-6dc9-49c1-bc61-ecdc3d8df6ff None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:41.495728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 158/323] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:41.500998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86da99-4cb1-4c0f-abbe-16441422fadb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:41.507906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b559b-3461-4f73-a418-d66d983ffa25 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.508720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b559b-3461-4f73-a418-d66d983ffa25 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.509053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b559b-3461-4f73-a418-d66d983ffa25 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.510502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 159/324] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:41.515978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5591c8-db01-446a-9e7e-96b1bd86d867 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.516259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5591c8-db01-446a-9e7e-96b1bd86d867 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.516532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5591c8-db01-446a-9e7e-96b1bd86d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.535474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-af5591c8-db01-446a-9e7e-96b1bd86d867 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:41.536658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-af5591c8-db01-446a-9e7e-96b1bd86d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:41.539452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:41.603369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 160/325] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:41.604215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5591c8-db01-446a-9e7e-96b1bd86d867 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:41.606536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86da99-4cb1-4c0f-abbe-16441422fadb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:41.643156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:41.643770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.644054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.644325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] PATH_INFO: `/v3/groups` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.644964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:41.646579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:41.705431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5591c8-db01-446a-9e7e-96b1bd86d867 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:41.735674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 166/326] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Oct 3 15:50:41 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:50:41.751900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:41.752464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.752743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.753011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.763408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:41.766774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:41.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:41.772742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:41.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 161/327] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:41.779533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:41.825630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:41.875080 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:41.892193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db1c0a-49bc-40ef-b84c-168f3cfc8fcc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:41.937194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:41.938025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:41.939554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:41.939554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:41.939749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:41.939990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:41.941383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:41.951656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 167/328] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:41.957380 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:41.988245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ff3b-f48d-49a4-b577-81a06f59c30f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:42.029934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:42.031078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:42.031874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:42.032635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:42.044884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:42.050126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:42.051059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:42.051865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:42.054136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 162/329] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:42.060019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:42.079767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:42.084451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fcfb6-1548-4107-9062-834f1a20f896 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:42.131045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:42.134022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:42.134690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:42.134971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:42.135655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] PATH_INFO: `/v3/users/a815f99fadfa469fbe2da0ac177df9aa` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:42.137160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] RBAC: Authorizing `identity:get_user(user_id=a815f99fadfa469fbe2da0ac177df9aa)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:42.138833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:42.140426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 168/330] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:41 2022] GET /identity/v3/users/a815f99fadfa469fbe2da0ac177df9aa => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:42.146246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:42.188333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6dac0-ebd4-4c67-8ad0-202968807f82 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:42.229948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:42.230574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:42.230857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:42.231133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:42.232259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:42.232259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:42.233487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:42.242365 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 163/331] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:42.247837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:42.282513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10dc0-b088-449c-81f4-c37241405a13 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:42.353504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541720c3-d39e-4139-9e90-6eb21fc0a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:42.354913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541720c3-d39e-4139-9e90-6eb21fc0a76d None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:42.355385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541720c3-d39e-4139-9e90-6eb21fc0a76d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:42.356139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541720c3-d39e-4139-9e90-6eb21fc0a76d None admin] PATH_INFO: `/v3/system/users/a815f99fadfa469fbe2da0ac177df9aa/roles/5fe956d1e23649e48d1c67402b297718` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:42.358193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541720c3-d39e-4139-9e90-6eb21fc0a76d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a815f99fadfa469fbe2da0ac177df9aa, role_id=5fe956d1e23649e48d1c67402b297718)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:42.360645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541720c3-d39e-4139-9e90-6eb21fc0a76d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:42.381614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484e00b-5fd2-4463-824a-1f6a94881a8a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:42.414197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:42.426916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:42.427553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:42.427838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:42.428121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] PATH_INFO: `/v3/users/c0cae103bc06422b802cc42084f041b2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:42.429312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] RBAC: Authorizing `identity:get_user(user_id=c0cae103bc06422b802cc42084f041b2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:42.431518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:42.433454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 164/332] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:42 2022] GET /identity/v3/users/c0cae103bc06422b802cc42084f041b2 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:42.439174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 169/333] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Oct 3 15:50:42 2022] PUT /identity/v3/system/users/a815f99fadfa469fbe2da0ac177df9aa/roles/5fe956d1e23649e48d1c67402b297718 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:50:42.442967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:42.564069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3be438-79d9-459a-aea1-a9a04c439704 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:42.603287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f981f3-1d6d-44ae-85bd-925c53b34739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:42.603918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f981f3-1d6d-44ae-85bd-925c53b34739 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:42.604203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f981f3-1d6d-44ae-85bd-925c53b34739 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:42.604480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f981f3-1d6d-44ae-85bd-925c53b34739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:42.605280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f981f3-1d6d-44ae-85bd-925c53b34739 None admin] RBAC: Adding query filter params (role.id=c2fb856e141d464e9be4bbf269169309, user.id=c0cae103bc06422b802cc42084f041b2, scope.system=all) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:42.605598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f981f3-1d6d-44ae-85bd-925c53b34739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:42.607105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f981f3-1d6d-44ae-85bd-925c53b34739 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:42.623091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 165/334] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Oct 3 15:50:42 2022] GET /identity/v3/role_assignments?user.id=c0cae103bc06422b802cc42084f041b2&scope.system=all&role.id=c2fb856e141d464e9be4bbf269169309 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:44.408420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436ab92-3628-4370-8b77-2835b9e06cae None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:44.408956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436ab92-3628-4370-8b77-2835b9e06cae None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:44.408956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436ab92-3628-4370-8b77-2835b9e06cae None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:44.411031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 170/335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:44.417338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e88b57-7321-4150-837e-472017b1d3bc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:44.417858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e88b57-7321-4150-837e-472017b1d3bc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:44.417933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e88b57-7321-4150-837e-472017b1d3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:44.447449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b5e88b57-7321-4150-837e-472017b1d3bc None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:44.448609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b5e88b57-7321-4150-837e-472017b1d3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:44.499033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:44.529955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 166/336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:44.754861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811a77-0648-4347-a1ae-1526ab8c9ffc None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:44.755480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811a77-0648-4347-a1ae-1526ab8c9ffc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:44.755947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811a77-0648-4347-a1ae-1526ab8c9ffc None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:44.757723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 171/337] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:44.763035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5261e-0501-4ec5-a225-5e5d3aa36db8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:44.763556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5261e-0501-4ec5-a225-5e5d3aa36db8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:44.764058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5261e-0501-4ec5-a225-5e5d3aa36db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:44.790723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-25a5261e-0501-4ec5-a225-5e5d3aa36db8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:44.792228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-25a5261e-0501-4ec5-a225-5e5d3aa36db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:44.880016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 167/338] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:45.149628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1811a77-0648-4347-a1ae-1526ab8c9ffc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:45.191553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:45.279476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1811a77-0648-4347-a1ae-1526ab8c9ffc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:45.325543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:45.326243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:45.326524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:45.326794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:45.344129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:45.349250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:45.350237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:45.351057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 172/339] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:45.356876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5261e-0501-4ec5-a225-5e5d3aa36db8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:45.435837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:45.476806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5261e-0501-4ec5-a225-5e5d3aa36db8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:45.488821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:45.532199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34267-4be0-4ca7-abe9-26d23cce6bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:45.532824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34267-4be0-4ca7-abe9-26d23cce6bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:45.533110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34267-4be0-4ca7-abe9-26d23cce6bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:45.533391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34267-4be0-4ca7-abe9-26d23cce6bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:45.534098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34267-4be0-4ca7-abe9-26d23cce6bc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:45.534409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34267-4be0-4ca7-abe9-26d23cce6bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:45.535903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34267-4be0-4ca7-abe9-26d23cce6bc0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:45.545688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 168/340] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:45.548221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23db38-0355-4646-bd16-52c3d2e2770a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:45.548861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23db38-0355-4646-bd16-52c3d2e2770a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:45.549333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23db38-0355-4646-bd16-52c3d2e2770a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:45.550904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 169/341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:45.555404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23db38-0355-4646-bd16-52c3d2e2770a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:45.663092 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:45.680354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c4ce-13d9-4c0d-8d06-e2176c746a5c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:45.699030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23db38-0355-4646-bd16-52c3d2e2770a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:45.725978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa758e9-2bef-4e69-9dc8-b356fb6c6c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:45.727378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa758e9-2bef-4e69-9dc8-b356fb6c6c2d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:45.727896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa758e9-2bef-4e69-9dc8-b356fb6c6c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:45.728372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa758e9-2bef-4e69-9dc8-b356fb6c6c2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:45.745821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa758e9-2bef-4e69-9dc8-b356fb6c6c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-daa758e9-2bef-4e69-9dc8-b356fb6c6c2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:45.752534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:45.753405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:45.754263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 173/342] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:45.755398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4794a-c646-42b5-a38b-f8daf37c7b0c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:45.755494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4794a-c646-42b5-a38b-f8daf37c7b0c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:45.755747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4794a-c646-42b5-a38b-f8daf37c7b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:45.757290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169761c5-3b27-4c74-891a-2cfb47e58b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:45.758243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169761c5-3b27-4c74-891a-2cfb47e58b1a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:45.758774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169761c5-3b27-4c74-891a-2cfb47e58b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:45.759240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169761c5-3b27-4c74-891a-2cfb47e58b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:45.776265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-62d4794a-c646-42b5-a38b-f8daf37c7b0c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:45.777458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-62d4794a-c646-42b5-a38b-f8daf37c7b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:45.816589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:45.849488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169761c5-3b27-4c74-891a-2cfb47e58b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:45.851180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169761c5-3b27-4c74-891a-2cfb47e58b1a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:45.864374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 174/343] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:45.866884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d1c3-2679-405b-879e-abfcb3cc96ac None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:45.867964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d1c3-2679-405b-879e-abfcb3cc96ac None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:45.868446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d1c3-2679-405b-879e-abfcb3cc96ac None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:45.875737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 175/344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:45.876545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42d1c3-2679-405b-879e-abfcb3cc96ac None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:46.038271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:46.043266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 170/345] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 15:50:46.047126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e40a-185a-4637-862e-c31bcf9413d0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.047410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e40a-185a-4637-862e-c31bcf9413d0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.047683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e40a-185a-4637-862e-c31bcf9413d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.077676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42d1c3-2679-405b-879e-abfcb3cc96ac None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:46.083022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-76c4e40a-185a-4637-862e-c31bcf9413d0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:46.084229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-76c4e40a-185a-4637-862e-c31bcf9413d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:46.117138 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:46.118005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.118366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.118641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.119308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:46.119611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:46.120987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:46.130636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 176/346] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:46.131725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:46.230807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:46.237559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 171/347] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:46.238656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4e40a-185a-4637-862e-c31bcf9413d0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:46.260192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f10e-2a57-4ee1-b39a-bc14fab55a15 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:46.332762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:46.333322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.333629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.334052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.336797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:46.338273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:46.339898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 177/348] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:46 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:46.342518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:46.374617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:46.399284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4e40a-185a-4637-862e-c31bcf9413d0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:46.480866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c5b8-c646-43b8-9df2-ba64b2e44ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:46.482403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c5b8-c646-43b8-9df2-ba64b2e44ade None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.482936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c5b8-c646-43b8-9df2-ba64b2e44ade None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.483410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c5b8-c646-43b8-9df2-ba64b2e44ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.521792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac859e-e32e-4a5c-942a-31d6c71a4557 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:46.559053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:46.559715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.560003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.560283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.572341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:46.577735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:46.578713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:46.579543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 178/349] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:46.580219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:46.597535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:46.602530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c5b8-c646-43b8-9df2-ba64b2e44ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:46.604804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c5b8-c646-43b8-9df2-ba64b2e44ade None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:46.666465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:46.709984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a715a-4e52-4f80-8964-ff8e845264c1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:46.749482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:46.750187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.750470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.750747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.750868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 172/350] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:46.752088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de382ee-4a97-4cdd-bb29-0defb4baed64 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.752372 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de382ee-4a97-4cdd-bb29-0defb4baed64 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.752749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de382ee-4a97-4cdd-bb29-0defb4baed64 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.754385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 173/351] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:46.755252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de382ee-4a97-4cdd-bb29-0defb4baed64 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:46.768551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:46.770367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:46.772246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 179/352] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:46 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:46.773217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:46.896969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:46.902585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de382ee-4a97-4cdd-bb29-0defb4baed64 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:46.926465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418abe2d-17d2-428e-9338-53367e175d13 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:46.958780 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ce254-8660-4aa7-8a7b-e7e5d861a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:46.959949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ce254-8660-4aa7-8a7b-e7e5d861a0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.960794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ce254-8660-4aa7-8a7b-e7e5d861a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.961288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ce254-8660-4aa7-8a7b-e7e5d861a0d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.962266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ce254-8660-4aa7-8a7b-e7e5d861a0d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:46.962597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ce254-8660-4aa7-8a7b-e7e5d861a0d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:46.964023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ce254-8660-4aa7-8a7b-e7e5d861a0d8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:46.975201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:46.976072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.976352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.977164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.978226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 174/353] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:46.982281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8d4a4-a6cc-4cf7-a82b-52f1c4a4884a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:46.982798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8d4a4-a6cc-4cf7-a82b-52f1c4a4884a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:46.983340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8d4a4-a6cc-4cf7-a82b-52f1c4a4884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:46.984155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:46.994431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:46.999330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:47.002759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 180/354] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:47.003554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.006159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1ec8d4a4-a6cc-4cf7-a82b-52f1c4a4884a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:47.007107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1ec8d4a4-a6cc-4cf7-a82b-52f1c4a4884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:47.101227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 175/355] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:47.102883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8d4a4-a6cc-4cf7-a82b-52f1c4a4884a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.142295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29d1f8-9d5b-47ad-935f-515abcce9141 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.190341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.191505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.192608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.192891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.194080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:47.195593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:47.198605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 181/356] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:47.199540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.214991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:47.226974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8d4a4-a6cc-4cf7-a82b-52f1c4a4884a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.274091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.275268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.275724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.275843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.276581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:47.276831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:47.278551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:47.279067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:47.285800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 176/357] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=c2fb856e141d464e9be4bbf269169309 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:47.286766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.330151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f11da-8592-4c9a-8135-d039c686f0ca None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.386144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c92fff-ffd9-497c-9648-1f54eb0bcb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.387236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92fff-ffd9-497c-9648-1f54eb0bcb40 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.387236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92fff-ffd9-497c-9648-1f54eb0bcb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.387411 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92fff-ffd9-497c-9648-1f54eb0bcb40 None admin] PATH_INFO: `/v3/users/a815f99fadfa469fbe2da0ac177df9aa` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.388659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c92fff-ffd9-497c-9648-1f54eb0bcb40 None admin] RBAC: Authorizing `identity:get_user(user_id=a815f99fadfa469fbe2da0ac177df9aa)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:47.390154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c92fff-ffd9-497c-9648-1f54eb0bcb40 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:47.391776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 182/358] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/users/a815f99fadfa469fbe2da0ac177df9aa => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:47.393152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966509b2-6fe9-4052-b4ff-3809d803c4ae None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.393441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966509b2-6fe9-4052-b4ff-3809d803c4ae None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.393712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966509b2-6fe9-4052-b4ff-3809d803c4ae None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.395079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 183/359] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:47.397025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966509b2-6fe9-4052-b4ff-3809d803c4ae None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.430980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc368302-1bec-4b7b-bef1-ed679f4b8f5b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.471032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.471615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.471896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.472169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.472850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:47.473161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:47.474603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:47.484646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 177/360] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:47.486297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.511912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:47.542704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966509b2-6fe9-4052-b4ff-3809d803c4ae None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.585026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:47.590832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.591517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.591800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.592165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.593513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:47.595058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:47.599844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 184/361] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:47.599844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.624101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae02ab4-e18e-4b96-93b4-a077e85067af None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.676857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba6255-c7ba-4c6e-994d-6c482cff3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.676857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6255-c7ba-4c6e-994d-6c482cff3b81 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.676857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6255-c7ba-4c6e-994d-6c482cff3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.676857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6255-c7ba-4c6e-994d-6c482cff3b81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.692865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba6255-c7ba-4c6e-994d-6c482cff3b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-99ba6255-c7ba-4c6e-994d-6c482cff3b81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:47.699098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:47.700073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 178/362] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:47.700919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f696-8f76-43c8-85d8-89772f949485 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.701694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f696-8f76-43c8-85d8-89772f949485 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.701694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3f696-8f76-43c8-85d8-89772f949485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.727257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c2a3f696-8f76-43c8-85d8-89772f949485 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:47.729098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c2a3f696-8f76-43c8-85d8-89772f949485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:47.741949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0e070-4e4b-475b-b834-7df23d7be24a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.788817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.790373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.790750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.791027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:47.791756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] RBAC: Adding query filter params (role.id=5fe956d1e23649e48d1c67402b297718, user.id=a815f99fadfa469fbe2da0ac177df9aa, scope.system=all) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:47.792065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:47.793512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:47.808308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 185/363] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/role_assignments?user.id=a815f99fadfa469fbe2da0ac177df9aa&scope.system=all&role.id=5fe956d1e23649e48d1c67402b297718 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:47.809375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.833324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 179/364] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:47.834643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f696-8f76-43c8-85d8-89772f949485 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:47.852221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:47.885114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:47.942438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5496810-4b2e-4a65-a366-f26342e6f7fa None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.983682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3f696-8f76-43c8-85d8-89772f949485 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:47.987198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:47.987198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:47.987412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:47.987692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.045693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:48.046350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:48.046624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:48.047156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.048833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:48.049207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:48.055692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:48.068035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 180/365] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=4eba1d0edde84f6da82050340e36f845 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:48.068895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:48.124119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:48.128062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:48.186230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:48.198055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:48.225539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b42ac-bbe3-4458-98c7-1af74676b9a4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:48.258986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 186/366] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:48.259664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:48.285611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:48.286289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:48.286569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:48.286844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.287520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:48.287825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:48.289774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:48.298953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 181/367] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:48.299798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:48.397734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeed48-112a-4c32-88c1-291640716967 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:48.480897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a488e-42aa-4ec4-b34e-48bc729f445c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:48.485213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:48.486666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:48.486666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:48.486666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.498175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:48.503877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:48.504774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:48.505574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 187/368] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:48.506314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:48.531467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:48.532107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:48.532367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:48.532640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.538405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:48.542387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:48.543877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:48.544832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 182/369] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:48.545436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:48.550641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:48.653524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291d00a-79cd-4002-a5f1-8b51558c2207 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:48.679177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf45d4-5785-4314-bad1-9b16ceef8db3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:48.692888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:48.693903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:48.694495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:48.694979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.717476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:48.718176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:48.718457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:48.718732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.719401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:48.719708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:48.721087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:48.731275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 183/370] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:48.732208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:48.777043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:48.778909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:48.801168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:48.818420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:48.871808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005bf16-af9c-4ae0-9278-c079cd5731c0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:48.917268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:48.918389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:48.918925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:48.919394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:48.920699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:48.922470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:48.924534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 184/371] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:48.925473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:48.931697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 188/372] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:48.933703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:49.056179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f377e-8a3a-489c-8d53-8ee448bf3aa6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:49.075615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1111c-1ab0-4a96-9706-c15906ad35b7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:49.084835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:49.104345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:49.105320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:49.105779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:49.106446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:49.107818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=09cfeb2bb213465c9343a0940f6a400c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:49.108396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:49.110132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:49.115898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:49.120636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 189/373] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=c2fb856e141d464e9be4bbf269169309 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:49.121903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:49.127981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:49.131160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:49.131641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:49.138107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:49.231071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:49.232807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:49.287684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb0ea4-8907-4001-b516-c4da9bba3dd9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:49.327052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:49.327671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:49.327956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:49.328232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:49.329401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:49.333787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:49.333787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 190/374] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:49 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:49.339103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:49.409714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 185/375] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:49.414918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:49.423938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:49.476118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:49.531920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08536b6b-fa38-41e0-86ef-86315d969266 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:49.579157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264bc32-0737-485f-9817-61fc805dcb78 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:49.600177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:49.600871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:49.601155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:49.601487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:49.603322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:49.604749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:49.606795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 191/376] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:49 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:49.612304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:49.649281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:49.650022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:49.650300 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:49.650571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] PATH_INFO: `/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:49.652664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] RBAC: Authorizing `identity:get_project(project_id=070db3b7d7b04a4ba14f4a1d107620fd)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:49.654133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:49.660146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 186/377] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:49 2022] GET /identity/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:49.664061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:49.790101 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9145ce-0370-46df-93ae-2db5e95e1dfb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:49.824475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:49.859286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:49.859958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:49.860237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:49.860518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:49.861365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=09cfeb2bb213465c9343a0940f6a400c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:49.861675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:49.863588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:49.872739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 192/378] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:49 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=4eba1d0edde84f6da82050340e36f845 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:49.880492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46876172-fdc3-4bc9-9abd-6bb008c77265 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:49.898200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:49.938072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eee3a-6f27-4440-a899-913d87e04bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:49.938813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eee3a-6f27-4440-a899-913d87e04bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:49.939623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eee3a-6f27-4440-a899-913d87e04bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:49.939898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eee3a-6f27-4440-a899-913d87e04bb5 None admin] PATH_INFO: `/v3/groups/9be7d15db2274ffe82e990dce65eacf6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:49.948795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eee3a-6f27-4440-a899-913d87e04bb5 None admin] RBAC: Authorizing `identity:get_group(group_id=9be7d15db2274ffe82e990dce65eacf6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:49.950339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eee3a-6f27-4440-a899-913d87e04bb5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:49.952291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 187/379] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:49 2022] GET /identity/v3/groups/9be7d15db2274ffe82e990dce65eacf6 => generated 229 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:49.959459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:50.090005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109294-9239-4cf8-8f9c-8cd0fb3dae69 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:50.147065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027297-c407-4915-939d-6bada09a7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:50.147660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027297-c407-4915-939d-6bada09a7f24 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:50.147940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027297-c407-4915-939d-6bada09a7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:50.148300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027297-c407-4915-939d-6bada09a7f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:50.150064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027297-c407-4915-939d-6bada09a7f24 None admin] RBAC: Adding query filter params (group.id=9be7d15db2274ffe82e990dce65eacf6, role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=070db3b7d7b04a4ba14f4a1d107620fd) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:50.150428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027297-c407-4915-939d-6bada09a7f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:50.151883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027297-c407-4915-939d-6bada09a7f24 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:50.160703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 193/380] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:49 2022] GET /identity/v3/role_assignments?group.id=9be7d15db2274ffe82e990dce65eacf6&scope.project.id=070db3b7d7b04a4ba14f4a1d107620fd&role.id=722cda8b508d40678af249ff70cb0751 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:50.216295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88705ea-1d1f-49ac-99a8-a2ca5322887f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:50.216639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88705ea-1d1f-49ac-99a8-a2ca5322887f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:50.216837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88705ea-1d1f-49ac-99a8-a2ca5322887f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:50.218541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 188/381] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:50.225337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6f8ff-995c-4f10-91a8-2d7acc3ea23b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:50.225870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6f8ff-995c-4f10-91a8-2d7acc3ea23b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:50.226357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6f8ff-995c-4f10-91a8-2d7acc3ea23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:50.252422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ece6f8ff-995c-4f10-91a8-2d7acc3ea23b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:50.253610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ece6f8ff-995c-4f10-91a8-2d7acc3ea23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:50.316033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:50.343691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 194/382] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:50.661178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88705ea-1d1f-49ac-99a8-a2ca5322887f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:50.805611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88705ea-1d1f-49ac-99a8-a2ca5322887f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:50.855186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:50.855827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:50.856108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:50.856379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:50.871570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:50.874972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ae290-9c72-40f6-b6f6-38e2850c8e01 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:50.875831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ae290-9c72-40f6-b6f6-38e2850c8e01 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:50.876325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ae290-9c72-40f6-b6f6-38e2850c8e01 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:50.876428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:50.877337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:50.878180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 189/383] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:50.880936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 195/384] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:50.883267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:50.885915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2eae-bbcc-432e-b9a6-74bb721ec35d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:50.886415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2eae-bbcc-432e-b9a6-74bb721ec35d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:50.886920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c2eae-bbcc-432e-b9a6-74bb721ec35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:50.915173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:50.926984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-660c2eae-bbcc-432e-b9a6-74bb721ec35d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:50.928546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-660c2eae-bbcc-432e-b9a6-74bb721ec35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:51.030042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3a43-ed83-45a6-9ad4-786c295a6ee9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:51.042422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 196/385] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:51.068818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:51.069803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:51.070338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:51.070811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:51.071695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:51.072219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:51.073870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:51.083201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 190/386] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:51.088945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c2eae-bbcc-432e-b9a6-74bb721ec35d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:51.214762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c2eae-bbcc-432e-b9a6-74bb721ec35d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:51.225784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:51.255840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:51.256477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:51.256763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:51.257045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:51.258771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:51.260179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:51.263098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 197/387] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:51 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:51.267213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:51.384806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:51.400953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779763-e57c-47cf-ba5d-6a268826b480 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:51.407208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:51.461601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:51.462268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:51.462546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:51.462821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:51.467182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:51.468576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:51.470664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 191/388] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:51 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:51.477053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:51.640986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6ad2-3900-4607-aca6-5ab5f4454f8d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:51.685012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e15fc-2a5b-4fe4-8e19-57944e916f43 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:51.686858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:51.686858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:51.687074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:51.687946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:51.700935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:51.709681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:51.710607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:51.711959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:51.712728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 198/389] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:51.731331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:51.779530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:51.780503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:51.781219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:51.781914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:51.785476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] RBAC: Authorizing `identity:create_grant(project_id=01d335aab075477caa5c8e2d01f3ff8a, group_id=c504b5aee0c346e0aad8d44fe5c98170, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:51.790105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:51.820498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:51.887089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 192/390] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Oct 3 15:50:51 2022] PUT /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:50:51.919075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d201d-2c80-4a3f-a9f3-76869a29a268 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:51.968838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26ce06-10f3-413b-b3be-5698ec6d42ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:51.969473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26ce06-10f3-413b-b3be-5698ec6d42ac None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:51.969798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26ce06-10f3-413b-b3be-5698ec6d42ac None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:51.970143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26ce06-10f3-413b-b3be-5698ec6d42ac None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:51.970839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26ce06-10f3-413b-b3be-5698ec6d42ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:51.971152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26ce06-10f3-413b-b3be-5698ec6d42ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:51.972711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26ce06-10f3-413b-b3be-5698ec6d42ac None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:51.982682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 199/391] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:51.990536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:52.015067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:52.059251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aae33-a244-4812-87dc-ac87b9e5cc6a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.059663 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aae33-a244-4812-87dc-ac87b9e5cc6a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.059810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aae33-a244-4812-87dc-ac87b9e5cc6a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.061319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 200/392] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:52.067189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1ee19-f8f1-4747-8fc1-d08dae717677 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.067630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1ee19-f8f1-4747-8fc1-d08dae717677 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.067914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1ee19-f8f1-4747-8fc1-d08dae717677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.094079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-54c1ee19-f8f1-4747-8fc1-d08dae717677 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:52.095320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-54c1ee19-f8f1-4747-8fc1-d08dae717677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:52.209886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eff1ff-2725-4198-9e99-25841f19c2ed None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:52.245110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 201/393] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:52.252552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:52.253538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.254045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.254553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.255889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:52.257543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:52.259464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 193/394] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:51 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:52.265069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1ee19-f8f1-4747-8fc1-d08dae717677 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:52.301612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:52.411370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1ee19-f8f1-4747-8fc1-d08dae717677 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:52.467898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:52.468548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.468826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.469095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.470339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:52.471798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:52.473734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 202/395] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:52 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:52.480730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:52.624678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:52.641335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:52.674869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c00d9-51fc-4f3b-af9b-ba10f9cb4fbb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:52.723449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43800b26-0912-4d24-a8d4-4afb689a4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:52.724190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43800b26-0912-4d24-a8d4-4afb689a4279 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.727233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43800b26-0912-4d24-a8d4-4afb689a4279 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.727233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43800b26-0912-4d24-a8d4-4afb689a4279 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.727523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43800b26-0912-4d24-a8d4-4afb689a4279 None admin] RBAC: Authorizing `identity:create_grant(project_id=01d335aab075477caa5c8e2d01f3ff8a, group_id=c504b5aee0c346e0aad8d44fe5c98170, role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:52.730654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43800b26-0912-4d24-a8d4-4afb689a4279 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:52.764090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:52.771222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96cbd9-4fac-49f1-a1e3-7f16715a9dc8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:52.812206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 194/396] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Oct 3 15:50:52 2022] PUT /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/4eba1d0edde84f6da82050340e36f845 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:52.813934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782a9a-4162-47ee-ac3c-33a4355dba18 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.814041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:52.814549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782a9a-4162-47ee-ac3c-33a4355dba18 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.814675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.815001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.815381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.815741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77782a9a-4162-47ee-ac3c-33a4355dba18 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.822418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 195/397] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:52.825117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbe74-9c6f-4f43-978b-0c9d581fb4a9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:52.826025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbe74-9c6f-4f43-978b-0c9d581fb4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:52.826537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbe74-9c6f-4f43-978b-0c9d581fb4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:52.835412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:52.840984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:52.841908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:52.843285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 203/398] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:52.851129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:52.852504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b79bbe74-9c6f-4f43-978b-0c9d581fb4a9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:52.854107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b79bbe74-9c6f-4f43-978b-0c9d581fb4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:52.974787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 196/399] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:53.041013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3015a-cfa8-46bf-8fbc-38d92562117d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:53.092206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbef2c-9d6e-4821-b879-8578048d64c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:53.092838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbef2c-9d6e-4821-b879-8578048d64c0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.093124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbef2c-9d6e-4821-b879-8578048d64c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.093464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbef2c-9d6e-4821-b879-8578048d64c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.094187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbef2c-9d6e-4821-b879-8578048d64c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:53.094582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbef2c-9d6e-4821-b879-8578048d64c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:53.096046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbef2c-9d6e-4821-b879-8578048d64c0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:53.109482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 204/400] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:53.115260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbe74-9c6f-4f43-978b-0c9d581fb4a9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:53.186189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d41e9-b774-4f05-b916-bb81a59f698b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.186499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d41e9-b774-4f05-b916-bb81a59f698b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.186749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d41e9-b774-4f05-b916-bb81a59f698b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.188509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 205/401] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:53.193113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c0a2-73a0-4cd3-92b2-2faf9ae803bb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.193397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c0a2-73a0-4cd3-92b2-2faf9ae803bb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.193674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c0a2-73a0-4cd3-92b2-2faf9ae803bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.204285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:53.218065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8eb7c0a2-73a0-4cd3-92b2-2faf9ae803bb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:53.219483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8eb7c0a2-73a0-4cd3-92b2-2faf9ae803bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:53.233148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:53.245647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbe74-9c6f-4f43-978b-0c9d581fb4a9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:53.302326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:53.303435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.303919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.304483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.306146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:53.308315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:53.310449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 206/403] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:53.310664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 197/403] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:53 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:53.311602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c0a2-73a0-4cd3-92b2-2faf9ae803bb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:53.319161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:53.462092 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c0a2-73a0-4cd3-92b2-2faf9ae803bb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:53.493826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08ed06-3f9f-4796-b041-91d3850a21d4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:53.505942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:53.506577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.506852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.507117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.523603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:53.529867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:53.530763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:53.531564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:53.532175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 207/404] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:53.541837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:53.566130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:53.566305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:53.566796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.567078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.567347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.568612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:53.570067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:53.572591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 198/405] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:53 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:53.577791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:53.598105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:53.688372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a76e-7935-4c79-9d14-6c8b387e07d8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:53.706418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379041-77d4-48fc-bcbc-1af545250b33 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:53.735616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:53.736425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.736841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.737247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.738083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:53.738523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:53.740159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:53.744274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:53.744984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.745364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.745734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.747916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] RBAC: Authorizing `identity:create_grant(project_id=09cfeb2bb213465c9343a0940f6a400c, group_id=c504b5aee0c346e0aad8d44fe5c98170, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:53.749514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:53.755722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 208/406] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:53.756733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:53.823909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:53.851363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 199/407] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Oct 3 15:50:53 2022] PUT /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:53.853202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:53.859286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2940dd4-3423-4ecc-9b39-4002190631ba None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:53.896265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:53.897153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:53.897604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:53.898052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:53.910016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:53.916483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:53.917453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:53.918280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:53.921028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 209/408] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:53.932152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:54.061695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce73593-1734-456a-9d60-d5bda232a2f6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:54.070060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:54.096819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:54.106678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:54.107631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.108107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.108560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.110996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:54.111500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:54.113494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:54.122935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d567-8e81-453a-b3c5-39a535d6812a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:54.124387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 210/409] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:54.130812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:54.173129 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:54.174156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.174668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.175135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.176447 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:54.178736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:54.186589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 200/410] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:53 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:54.187479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:54.279968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c88cd-9aa2-4fcb-b9dc-395c9d93337a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:54.315368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b2501-b78b-4416-a5dd-8a5c574da240 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:54.355761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:54.356776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.357259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.357740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.359327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:54.359551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:54.360197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.360481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.360759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] PATH_INFO: `/v3/groups/9be7d15db2274ffe82e990dce65eacf6` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.361971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:54.368887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] RBAC: Authorizing `identity:get_group(group_id=9be7d15db2274ffe82e990dce65eacf6)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:54.368887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:54.369264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 201/411] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:54 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:54.369965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 211/412] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:54 2022] GET /identity/v3/groups/9be7d15db2274ffe82e990dce65eacf6 => generated 229 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:54.370902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:54.375768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:54.389225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:54.495396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a9677-9405-466c-9082-ad3cacb85122 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:54.524898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:54.533207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:54.533988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.534278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.541306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.541306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] RBAC: Authorizing `identity:create_grant(project_id=09cfeb2bb213465c9343a0940f6a400c, group_id=c504b5aee0c346e0aad8d44fe5c98170, role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:54.541306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:54.578471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829af88-1e7d-47ac-9fe5-85571c65ed34 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:54.618245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 202/413] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Oct 3 15:50:54 2022] PUT /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c/groups/c504b5aee0c346e0aad8d44fe5c98170/roles/4eba1d0edde84f6da82050340e36f845 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:50:54.630359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da89cba-df37-456d-be9d-91367d2084c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:54.631379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89cba-df37-456d-be9d-91367d2084c8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.631893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89cba-df37-456d-be9d-91367d2084c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.632385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da89cba-df37-456d-be9d-91367d2084c8 None admin] PATH_INFO: `/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.633791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da89cba-df37-456d-be9d-91367d2084c8 None admin] RBAC: Authorizing `identity:get_project(project_id=070db3b7d7b04a4ba14f4a1d107620fd)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:54.635544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da89cba-df37-456d-be9d-91367d2084c8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:54.637599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 212/414] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:54 2022] GET /identity/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:54.643934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:54.733524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc94052-bc03-440b-9122-3f6994cc8e89 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.733843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc94052-bc03-440b-9122-3f6994cc8e89 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.734129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc94052-bc03-440b-9122-3f6994cc8e89 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.735681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 213/415] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:54.747176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21554-3f0b-4c7d-91de-a076777d937f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.747469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21554-3f0b-4c7d-91de-a076777d937f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.747731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21554-3f0b-4c7d-91de-a076777d937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.764172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:54.781597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d4e21554-3f0b-4c7d-91de-a076777d937f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:54.782851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d4e21554-3f0b-4c7d-91de-a076777d937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:54.806620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd5106-9c81-48ae-885f-895f2a7fa26e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:54.861158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:54.861868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:54.862156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:54.862437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] PATH_INFO: `/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd/groups/9be7d15db2274ffe82e990dce65eacf6/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:54.864496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=070db3b7d7b04a4ba14f4a1d107620fd, group_id=9be7d15db2274ffe82e990dce65eacf6, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:54.866019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:54.911793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 214/416] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:54.952993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 203/417] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Oct 3 15:50:54 2022] PUT /identity/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd/groups/9be7d15db2274ffe82e990dce65eacf6/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:50:55.333260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21554-3f0b-4c7d-91de-a076777d937f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:55.409191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:55.468538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21554-3f0b-4c7d-91de-a076777d937f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:55.512388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a900c1-cc44-4e17-b3ed-fde05a69fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:55.513033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a900c1-cc44-4e17-b3ed-fde05a69fa4c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:55.513315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a900c1-cc44-4e17-b3ed-fde05a69fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:55.513590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a900c1-cc44-4e17-b3ed-fde05a69fa4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:55.525812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a900c1-cc44-4e17-b3ed-fde05a69fa4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c6a900c1-cc44-4e17-b3ed-fde05a69fa4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:55.531227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:55.532084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:55.532873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 215/418] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:55.538694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:55.656461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a562-c718-43a6-ae64-cba816b239d8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:55.693224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:55.707262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68847aa8-e82f-4970-affc-bc08e3f386e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:55.708163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68847aa8-e82f-4970-affc-bc08e3f386e2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:55.708601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68847aa8-e82f-4970-affc-bc08e3f386e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:55.709027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68847aa8-e82f-4970-affc-bc08e3f386e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:55.711654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68847aa8-e82f-4970-affc-bc08e3f386e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:55.711654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68847aa8-e82f-4970-affc-bc08e3f386e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:55.712061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68847aa8-e82f-4970-affc-bc08e3f386e2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:55.720324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3d3a-f922-4ecc-ad0b-a060775df671 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:55.724243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 204/419] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:55.724436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3d3a-f922-4ecc-ad0b-a060775df671 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:55.724713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e3d3a-f922-4ecc-ad0b-a060775df671 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:55.726356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 216/420] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:55.732109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4712f8-96b7-4c06-af72-79266262eb4b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:55.732757 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4712f8-96b7-4c06-af72-79266262eb4b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:55.732757 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4712f8-96b7-4c06-af72-79266262eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:55.736672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e3d3a-f922-4ecc-ad0b-a060775df671 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:55.767516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ce4712f8-96b7-4c06-af72-79266262eb4b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:55.768748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ce4712f8-96b7-4c06-af72-79266262eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:55.904374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 205/421] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:50:55.912356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e3d3a-f922-4ecc-ad0b-a060775df671 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:55.930532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:55.948431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:55.949046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:55.949386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:55.949671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.037117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:56.038602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:56.143577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 217/422] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:56.150009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4712f8-96b7-4c06-af72-79266262eb4b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:56.277577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4712f8-96b7-4c06-af72-79266262eb4b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:56.308080 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:56.319962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:56.345158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:56.345827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:56.346116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:56.346395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.354196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:56.354735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:56.356261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:56.358122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 206/423] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:56 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:56.382229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:56.513946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bf5d-86a5-4cdc-b31b-300decf94175 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:56.550459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0adee4-b32d-482e-8818-0481fa757c6a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:56.555173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d57be-8269-46b3-8e64-4fa24fafa5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:56.555823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d57be-8269-46b3-8e64-4fa24fafa5aa None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:56.556106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d57be-8269-46b3-8e64-4fa24fafa5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:56.556382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d57be-8269-46b3-8e64-4fa24fafa5aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.567248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d57be-8269-46b3-8e64-4fa24fafa5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-595d57be-8269-46b3-8e64-4fa24fafa5aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:56.572706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:56.573570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:56.574397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:56.580073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 218/424] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:56.583543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3caa4-7989-41d9-a75f-b242652f87f9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:56.583843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3caa4-7989-41d9-a75f-b242652f87f9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:56.584179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3caa4-7989-41d9-a75f-b242652f87f9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.585579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 219/425] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:56.592849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bebd8-37fa-496d-95db-27b91a1d0c32 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:56.593149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bebd8-37fa-496d-95db-27b91a1d0c32 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:56.593404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bebd8-37fa-496d-95db-27b91a1d0c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.596487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:56.597959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:56.598495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:56.598978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.600689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:56.604003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:56.607480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 207/426] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:56 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:56.608571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:56.620045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-206bebd8-37fa-496d-95db-27b91a1d0c32 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:56.621246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-206bebd8-37fa-496d-95db-27b91a1d0c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:56.680554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:56.697786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 220/427] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:56.697786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bebd8-37fa-496d-95db-27b91a1d0c32 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:56.708941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:56.746863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be45c7-a1e0-4f11-a8f2-ddddf71dc194 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:56.809279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:56.809917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:56.810081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:56.810342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.811007 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:56.811307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:56.812677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:56.826051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 208/428] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:56.832394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:56.883706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bebd8-37fa-496d-95db-27b91a1d0c32 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:56.928075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:56.929016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:56.929584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:56.930076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:56.931490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:56.933550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:56.935212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:56.954141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 221/429] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:56 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=c2fb856e141d464e9be4bbf269169309 => generated 611 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:57.015990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.021914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ba469-2ce2-462d-8c2b-2fdc5d73cbfd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:57.038281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:57.067591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:57.068622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.069118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.069634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.095166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:57.131059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf5f0-28c9-4e29-b457-bb5419fcf923 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:57.175036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cbcfb-332d-4d73-a88b-49515c5e03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:57.176086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cbcfb-332d-4d73-a88b-49515c5e03c0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.176564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cbcfb-332d-4d73-a88b-49515c5e03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.177030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cbcfb-332d-4d73-a88b-49515c5e03c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.200904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cbcfb-332d-4d73-a88b-49515c5e03c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ca0cbcfb-332d-4d73-a88b-49515c5e03c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:57.210823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:57.211805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 15:50:57.212618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:50:57.216548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 222/430] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:50:57.221316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d427-4a2b-4f6e-8f9c-d470c414a803 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.221316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d427-4a2b-4f6e-8f9c-d470c414a803 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.221316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d427-4a2b-4f6e-8f9c-d470c414a803 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.222634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 223/431] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:50:57.223865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:57.225699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:57.228605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adcf7-ae84-4885-a249-d52fbf9df98b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.228756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adcf7-ae84-4885-a249-d52fbf9df98b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.228954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133adcf7-ae84-4885-a249-d52fbf9df98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.248543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-133adcf7-ae84-4885-a249-d52fbf9df98b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:57.249750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-133adcf7-ae84-4885-a249-d52fbf9df98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:57.336942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 224/432] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:57.338081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adcf7-ae84-4885-a249-d52fbf9df98b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.373954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 209/433] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:57.382852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.401436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:57.430044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:57.492233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133adcf7-ae84-4885-a249-d52fbf9df98b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:57.516368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cd7c7-f49f-48cb-94aa-9ed95b6124ee None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:57.540973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:57.541590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.541902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.542176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.542839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:57.543142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:57.544722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:57.557017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 225/434] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:57.562626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.565330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:57.566541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.567030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.567507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] PATH_INFO: `/v3/projects/01d335aab075477caa5c8e2d01f3ff8a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.570815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] RBAC: Authorizing `identity:get_project(project_id=01d335aab075477caa5c8e2d01f3ff8a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:57.572495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:57.579895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 210/435] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/projects/01d335aab075477caa5c8e2d01f3ff8a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:57.583324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.691481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:57.714106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6c43-7567-4ee2-a86d-3d4973e538c5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:57.723862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48f272-ac6c-4d37-baf8-25192bb3c4a9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:57.760777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:57.763221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:57.763712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.763997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.764277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.765424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:57.766974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:57.768668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 211/436] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:57.774127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.775349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:57.775975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.776260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.776534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.845267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:57.846742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:57.872672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815f25b-ebb4-4209-b1e7-623794365df2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:57.906081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964f25a-6589-4ff3-986d-6aecea8f60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:57.906704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964f25a-6589-4ff3-986d-6aecea8f60f3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.907048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964f25a-6589-4ff3-986d-6aecea8f60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.907330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964f25a-6589-4ff3-986d-6aecea8f60f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.917453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964f25a-6589-4ff3-986d-6aecea8f60f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6964f25a-6589-4ff3-986d-6aecea8f60f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:57.922295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:57.923302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:57.924086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 212/437] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:57.924730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feccce-a0b6-4f5a-bdda-120ccffbb6ac None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:57.924803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feccce-a0b6-4f5a-bdda-120ccffbb6ac None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:57.925071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feccce-a0b6-4f5a-bdda-120ccffbb6ac None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:57.926484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 213/438] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:50:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:50:57.927107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feccce-a0b6-4f5a-bdda-120ccffbb6ac None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.940165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:57.952868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 226/439] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 15:50:57.952868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:57.975009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:58.038406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feccce-a0b6-4f5a-bdda-120ccffbb6ac None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.052378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2ba8b-ab85-4b90-9611-68c54788fcc2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.074746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750b5f8-4e17-4013-89b9-40f4a82b06e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.075347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750b5f8-4e17-4013-89b9-40f4a82b06e5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.075619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750b5f8-4e17-4013-89b9-40f4a82b06e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.075889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750b5f8-4e17-4013-89b9-40f4a82b06e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.076663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750b5f8-4e17-4013-89b9-40f4a82b06e5 None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=01d335aab075477caa5c8e2d01f3ff8a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:58.076974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750b5f8-4e17-4013-89b9-40f4a82b06e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.078437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750b5f8-4e17-4013-89b9-40f4a82b06e5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.084292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 214/440] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=01d335aab075477caa5c8e2d01f3ff8a&role.id=4eba1d0edde84f6da82050340e36f845 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:58.085385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8928-4274-4831-b1eb-822b70976663 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.085718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8928-4274-4831-b1eb-822b70976663 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.086105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c8928-4274-4831-b1eb-822b70976663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.092703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.093593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.093907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.094184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.094911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:58.095223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.096636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.111402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 227/441] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:50:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:58.111402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.115092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fe1c8928-4274-4831-b1eb-822b70976663 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:50:58.116308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fe1c8928-4274-4831-b1eb-822b70976663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:50:58.204110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 215/442] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:50:58.205289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8928-4274-4831-b1eb-822b70976663 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.209939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:58.219249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:58.237328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb224b95-bcd7-4d00-bc77-2761003384bc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.280115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.280873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.281156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.281430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.284083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.285534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.289804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 228/443] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:58.293013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.330859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c8928-4274-4831-b1eb-822b70976663 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.381507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.383189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.383681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.384158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.440012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d502a-2eb5-4b6c-a11f-84e3227d4c30 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.471037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.473232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.478009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:58.478907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.479547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.479826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.480099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.481225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.482771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.484689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 229/444] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:58.494017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.520509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:58.591661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 216/445] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:50:58.592509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.604802 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cb634-4b04-422e-9bf4-7ef3531dd8dd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.639048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.639650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.639958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.640234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.640957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=c2fb856e141d464e9be4bbf269169309, scope.project.id=09cfeb2bb213465c9343a0940f6a400c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:58.641266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.642722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.648357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 230/446] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=c2fb856e141d464e9be4bbf269169309 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:58.661959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.726223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71734e-fe0f-4af9-b4aa-c38ef2e21ccb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.737747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:58.754256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:58.768632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.769327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.769965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.770560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.772512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b501b91-16a0-481f-9e00-678b8d956051 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.784198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:50:58.790514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:50:58.791634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:50:58.793071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 217/447] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:50:58.797702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.815217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.815868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.816148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.816421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] PATH_INFO: `/v3/projects/09cfeb2bb213465c9343a0940f6a400c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.817566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] RBAC: Authorizing `identity:get_project(project_id=09cfeb2bb213465c9343a0940f6a400c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.819043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.821064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 231/448] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/projects/09cfeb2bb213465c9343a0940f6a400c => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:58.826440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:58.914888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc35fc8-4e32-4eb5-98b3-64962e6ec032 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.954940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9604-2272-49e7-aa05-bca94d152e89 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:58.958239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:58.958239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:58.958445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:58.958643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:58.959867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:58.959867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:58.960984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:58.970992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 218/449] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:58.977275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:59.000598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:59.001246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:59.001524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:59.001850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] PATH_INFO: `/v3/groups/c504b5aee0c346e0aad8d44fe5c98170` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:59.002971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] RBAC: Authorizing `identity:get_group(group_id=c504b5aee0c346e0aad8d44fe5c98170)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:59.004401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:59.006786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 232/450] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/groups/c504b5aee0c346e0aad8d44fe5c98170 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:59.012047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:59.012531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:59.043402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:59.094166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538628b-f9fc-4650-923a-4f84bc05aaba None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:59.128866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:59.129468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:59.129749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:59.130054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:59.130247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386427e4-cfc6-429b-b44d-141defa87e6b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:59.163555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:59.165283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:59.165567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:59.165881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:59.166606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] RBAC: Adding query filter params (group.id=c504b5aee0c346e0aad8d44fe5c98170, role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=09cfeb2bb213465c9343a0940f6a400c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:59.166919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:59.168356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:59.173995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 233/451] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:59 2022] GET /identity/v3/role_assignments?group.id=c504b5aee0c346e0aad8d44fe5c98170&scope.project.id=09cfeb2bb213465c9343a0940f6a400c&role.id=4eba1d0edde84f6da82050340e36f845 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:50:59.198977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:59.200457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:59.229785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:59.305709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 219/452] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 15:50:59.311516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:59.407828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:59.424256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847ae9f-514f-43bf-868f-dbaf8802e2f2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:59.458083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:59.458718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:59.458997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:59.459271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] PATH_INFO: `/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:59.460377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] RBAC: Authorizing `identity:get_project(project_id=070db3b7d7b04a4ba14f4a1d107620fd)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:59.462392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:59.464000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 234/453] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:50:59 2022] GET /identity/v3/projects/070db3b7d7b04a4ba14f4a1d107620fd => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:59.469562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:59.571154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162085b5-4a8d-49da-83b0-f2a0c2b1684a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:59.595509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:50:59.603720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cacb6-403f-488c-a397-1eed9e688329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:59.607533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cacb6-403f-488c-a397-1eed9e688329 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:59.607533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cacb6-403f-488c-a397-1eed9e688329 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:59.607533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cacb6-403f-488c-a397-1eed9e688329 None admin] PATH_INFO: `/v3/groups/9be7d15db2274ffe82e990dce65eacf6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:59.607533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cacb6-403f-488c-a397-1eed9e688329 None admin] RBAC: Authorizing `identity:get_group(group_id=9be7d15db2274ffe82e990dce65eacf6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:59.607533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cacb6-403f-488c-a397-1eed9e688329 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:59.608903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 220/454] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Oct 3 15:50:59 2022] GET /identity/v3/groups/9be7d15db2274ffe82e990dce65eacf6 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:50:59.614826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:50:59.714009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2d76e-528a-4a2c-ad8b-2caea99e6029 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:50:59.750134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f5646-5818-4fe2-8f78-69959e7f03a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:50:59.750741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f5646-5818-4fe2-8f78-69959e7f03a9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:50:59.751017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f5646-5818-4fe2-8f78-69959e7f03a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:50:59.751283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f5646-5818-4fe2-8f78-69959e7f03a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:50:59.751992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f5646-5818-4fe2-8f78-69959e7f03a9 None admin] RBAC: Adding query filter params (group.id=9be7d15db2274ffe82e990dce65eacf6, role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=070db3b7d7b04a4ba14f4a1d107620fd) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:50:59.752299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f5646-5818-4fe2-8f78-69959e7f03a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:50:59.753706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f5646-5818-4fe2-8f78-69959e7f03a9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:50:59.759804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 235/455] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Oct 3 15:50:59 2022] GET /identity/v3/role_assignments?group.id=9be7d15db2274ffe82e990dce65eacf6&scope.project.id=070db3b7d7b04a4ba14f4a1d107620fd&role.id=722cda8b508d40678af249ff70cb0751 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:02.547231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6bfb-542b-401e-919b-b89f426952f3 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:02.547849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6bfb-542b-401e-919b-b89f426952f3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:02.547849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a6bfb-542b-401e-919b-b89f426952f3 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:02.549543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 221/456] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:02.555158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23ba2-7530-47d2-9a14-1ee092c3ee12 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:02.556051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23ba2-7530-47d2-9a14-1ee092c3ee12 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:02.556555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a23ba2-7530-47d2-9a14-1ee092c3ee12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:02.576489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-49a23ba2-7530-47d2-9a14-1ee092c3ee12 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:02.578135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-49a23ba2-7530-47d2-9a14-1ee092c3ee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:02.597572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:02.606548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee94bb2-aa3b-4c4f-9e86-9b19557932a3 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:02.613851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee94bb2-aa3b-4c4f-9e86-9b19557932a3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:02.613851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee94bb2-aa3b-4c4f-9e86-9b19557932a3 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:02.613851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 222/457] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:02.621561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748010c-3cc9-4cc7-97d2-ed2bdbd58ecb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:02.621861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748010c-3cc9-4cc7-97d2-ed2bdbd58ecb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:02.622512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748010c-3cc9-4cc7-97d2-ed2bdbd58ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:02.643415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c748010c-3cc9-4cc7-97d2-ed2bdbd58ecb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:02.644882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c748010c-3cc9-4cc7-97d2-ed2bdbd58ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:02.696853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 236/458] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:02.763321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 223/459] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:02.869696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f2cda-508c-4a73-85b3-4dffe47df6a9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:02.870017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f2cda-508c-4a73-85b3-4dffe47df6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:02.870539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f2cda-508c-4a73-85b3-4dffe47df6a9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:02.872512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 237/460] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:02.878196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96eef-3f1a-4a57-98ab-1eb40a7ec35c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:02.878846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96eef-3f1a-4a57-98ab-1eb40a7ec35c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:02.879327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96eef-3f1a-4a57-98ab-1eb40a7ec35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:02.904637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-83a96eef-3f1a-4a57-98ab-1eb40a7ec35c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:02.906610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-83a96eef-3f1a-4a57-98ab-1eb40a7ec35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:02.994657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 224/461] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:03.060219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6df7c-af97-4d01-95cc-d9885d5d3335 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.060847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6df7c-af97-4d01-95cc-d9885d5d3335 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.061351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6df7c-af97-4d01-95cc-d9885d5d3335 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.062982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 238/462] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:03.068247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69723f79-1ab2-4009-8a44-a77f9e196223 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.068753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69723f79-1ab2-4009-8a44-a77f9e196223 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.069252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69723f79-1ab2-4009-8a44-a77f9e196223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.098171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-69723f79-1ab2-4009-8a44-a77f9e196223 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:03.099713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-69723f79-1ab2-4009-8a44-a77f9e196223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:03.129884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6df7c-af97-4d01-95cc-d9885d5d3335 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.173956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:03.187949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 225/463] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:03.189157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69723f79-1ab2-4009-8a44-a77f9e196223 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.275944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6df7c-af97-4d01-95cc-d9885d5d3335 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.336888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.337924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.338455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.338908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.354334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.355193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69723f79-1ab2-4009-8a44-a77f9e196223 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.355790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:03.364528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:03.374324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:03.386480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:03.387550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:03.387550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.387550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:03.387550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 239/464] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:03.387550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.404796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.405982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.406408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.406866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.428643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.430386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:03.448961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:03.450393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:03.451446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:03.451446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.451446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:03.452706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 226/465] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:03.458770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.499584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12bc2-f81e-4854-baf9-bc6245323d30 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.499883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:03.539745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.541053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.541510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.542009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.560957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.564246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:03.591395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00325f52-3c2e-4d9a-ac1e-3d4c3de16461 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:03.594100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:03.594965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:03.595832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:03.595832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.595832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:03.602060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 240/466] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:03.602060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.642229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.642936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.643343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.643790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.644543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:03.645013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.646846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:03.660375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 227/467] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:03.661178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.674704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:03.730836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aee68-4fe9-48fd-95da-0718671708ba None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.768566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:03.768897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.769477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.769753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.770303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.770691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:03.771151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.773755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:03.775053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ad115-76c8-4bab-acfe-dc1979bf3941 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.786419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 241/468] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:03.791787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.815309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.815941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.816225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.816523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.827033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.828525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:03.846004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:03.847224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:03.848118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:03.848118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:03.848118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:03.848118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 228/469] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:03.848118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.906299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a560b3d-1b82-4cc4-9572-ea2c810ee2eb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.917615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:03.941552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.942232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.942523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.942804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.943452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:03.943764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.945696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:03.957388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 242/470] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:03.958223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:03.959153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963379ba-fc48-44e0-b9d3-d6cefb5c5af8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:03.993264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:03.993903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:03.994186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:03.994460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:03.995095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:03.996536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:04.058838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940cd1a-6ac0-4ae1-99ed-7f218ff50c7e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:04.090914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98ed91-d7e6-4d21-b04f-54288cfea005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:04.091506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ed91-d7e6-4d21-b04f-54288cfea005 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:04.091833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ed91-d7e6-4d21-b04f-54288cfea005 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:04.092146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98ed91-d7e6-4d21-b04f-54288cfea005 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:04.092783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98ed91-d7e6-4d21-b04f-54288cfea005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:04.094223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98ed91-d7e6-4d21-b04f-54288cfea005 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:04.107200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 229/471] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:51:03 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:04.108020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:04.112524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:04.205975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 243/472] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:51:03 2022] POST /identity/v3/users => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:04.208432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e4f8-771e-4e36-90dc-cc1a69f1998e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:04.209065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e4f8-771e-4e36-90dc-cc1a69f1998e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:04.209597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e4f8-771e-4e36-90dc-cc1a69f1998e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:04.211815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 244/473] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:04.212904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3e4f8-771e-4e36-90dc-cc1a69f1998e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:04.223872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1137-ea25-4d6a-b1a1-ef9b89ec289e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:04.253555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:04.265883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704802-6896-4faa-bdfe-ce25b147b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:04.266621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704802-6896-4faa-bdfe-ce25b147b903 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:04.267018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704802-6896-4faa-bdfe-ce25b147b903 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:04.267373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704802-6896-4faa-bdfe-ce25b147b903 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:04.268116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82704802-6896-4faa-bdfe-ce25b147b903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:04.268497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82704802-6896-4faa-bdfe-ce25b147b903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:04.270033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82704802-6896-4faa-bdfe-ce25b147b903 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:04.285816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 230/474] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:04.285816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e586bb-a0c9-4e3d-965f-bc9cdfda8e2a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:04.285816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e586bb-a0c9-4e3d-965f-bc9cdfda8e2a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:04.285816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e586bb-a0c9-4e3d-965f-bc9cdfda8e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:04.310503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-02e586bb-a0c9-4e3d-965f-bc9cdfda8e2a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:04.311750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-02e586bb-a0c9-4e3d-965f-bc9cdfda8e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:04.364988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3e4f8-771e-4e36-90dc-cc1a69f1998e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:04.396687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:04.413400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:04.414733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:04.415017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:04.415186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 231/475] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:04.415471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:04.415998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e586bb-a0c9-4e3d-965f-bc9cdfda8e2a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:04.416120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:04.417557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:04.529430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 245/476] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:51:04 2022] POST /identity/v3/users => generated 248 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:04.536309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e586bb-a0c9-4e3d-965f-bc9cdfda8e2a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:04.577814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:04.578439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:04.578721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:04.578993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:04.579811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:04.581306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:04.706875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:04.709206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 232/477] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:51:04 2022] POST /identity/v3/users => generated 249 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:04.811069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:04.831370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fcd8c-5824-4e96-a654-a5e2ad6978f9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:04.871205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:04.871825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:04.872205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:04.872479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:04.873223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:04.874658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:04.925591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.sql.core [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 15:51:04.925591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 15:51:04.925591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [parameters: {'id': '119ce6ed672943e1827897a6348d524b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 15:51:04.925591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81563) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Oct 03 15:51:04.942940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return ref.to_dict() Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 15:51:04.943849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application yield resource Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise self.value Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application session.commit() Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 15:51:04.944763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.flush() Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application compat.raise_( Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 15:51:04.946433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 15:51:04.947475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 15:51:04.948300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [parameters: {'id': '119ce6ed672943e1827897a6348d524b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:04.949162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 15:51:04.951371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:04.953093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 246/478] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Oct 3 15:51:04 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:04.953222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:05.017099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:05.083945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba378cd-3a1a-4717-8efb-1a6bbac2d39a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:05.129280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13da965-1cb9-45e2-845a-f2c6a1d89474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:05.130287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13da965-1cb9-45e2-845a-f2c6a1d89474 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:05.130798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13da965-1cb9-45e2-845a-f2c6a1d89474 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:05.131267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13da965-1cb9-45e2-845a-f2c6a1d89474 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:05.150696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13da965-1cb9-45e2-845a-f2c6a1d89474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f13da965-1cb9-45e2-845a-f2c6a1d89474 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:05.156686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:05.157576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 15:51:05.158504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:05.160816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 233/479] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:05.166869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:05.322206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b72ccc-1992-4ce7-ac6d-4a825acc0c51 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:05.356811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c142171-6fc2-49e2-a2a6-9356e8c93dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:05.357413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142171-6fc2-49e2-a2a6-9356e8c93dab None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:05.357692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142171-6fc2-49e2-a2a6-9356e8c93dab None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:05.358004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142171-6fc2-49e2-a2a6-9356e8c93dab None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:05.358667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c142171-6fc2-49e2-a2a6-9356e8c93dab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:05.358966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c142171-6fc2-49e2-a2a6-9356e8c93dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:05.360321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c142171-6fc2-49e2-a2a6-9356e8c93dab None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:05.369850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 247/480] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:06.672980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b29b-67f3-4825-af2e-9e739f75b467 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:06.673499 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b29b-67f3-4825-af2e-9e739f75b467 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:06.673608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b29b-67f3-4825-af2e-9e739f75b467 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:06.675171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 234/481] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:06.680550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facee9d-328d-4da0-beda-b12ecdf91059 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:06.680953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facee9d-328d-4da0-beda-b12ecdf91059 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:06.681121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facee9d-328d-4da0-beda-b12ecdf91059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:06.710950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3facee9d-328d-4da0-beda-b12ecdf91059 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:06.712168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3facee9d-328d-4da0-beda-b12ecdf91059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:06.714316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:06.799921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 248/482] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:07.090909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896012d8-2f86-48b1-8065-a4eae3ee6832 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.091239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896012d8-2f86-48b1-8065-a4eae3ee6832 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.091414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896012d8-2f86-48b1-8065-a4eae3ee6832 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.092948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 235/483] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:07.097874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4bef-6d92-4200-8234-ada23ca7d3ee None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.098222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4bef-6d92-4200-8234-ada23ca7d3ee None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.098501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4bef-6d92-4200-8234-ada23ca7d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.126761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-953d4bef-6d92-4200-8234-ada23ca7d3ee None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:07.127946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-953d4bef-6d92-4200-8234-ada23ca7d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:07.159456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896012d8-2f86-48b1-8065-a4eae3ee6832 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:07.201293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 249/484] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:07.341995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896012d8-2f86-48b1-8065-a4eae3ee6832 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:07.356114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:07.371307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43956-f1da-4a61-b0ff-682cb964d778 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.373980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43956-f1da-4a61-b0ff-682cb964d778 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.373980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43956-f1da-4a61-b0ff-682cb964d778 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.373980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 250/485] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:51:07.380217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177ac0-2621-4734-b2c3-3dc2eef3a8f7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.380500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177ac0-2621-4734-b2c3-3dc2eef3a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.380778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177ac0-2621-4734-b2c3-3dc2eef3a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.403028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:07.403671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.404010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.404282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.414686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a4177ac0-2621-4734-b2c3-3dc2eef3a8f7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:07.415875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a4177ac0-2621-4734-b2c3-3dc2eef3a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:07.423337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:07.428112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:07.431725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:07.433414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 236/486] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:07.439633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:07.531104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:07.538965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 251/487] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:51:07.540850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc050b-ea10-4e03-896d-15771f07c1df None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.541580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc050b-ea10-4e03-896d-15771f07c1df None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.542387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc050b-ea10-4e03-896d-15771f07c1df None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.545181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 252/488] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:07.557876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052b61b-dc09-42bf-9b2b-7c62f40d525c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.558565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052b61b-dc09-42bf-9b2b-7c62f40d525c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.559115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052b61b-dc09-42bf-9b2b-7c62f40d525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.586367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a052b61b-dc09-42bf-9b2b-7c62f40d525c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:07.587673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a052b61b-dc09-42bf-9b2b-7c62f40d525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:07.604100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a4cc-b9fe-49e6-b044-babeb5fe44b8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:07.652409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:07.653595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.654066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.654795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.656186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:07.656929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:07.658519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:07.665603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 253/489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:07.665603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052b61b-dc09-42bf-9b2b-7c62f40d525c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:07.679854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 237/490] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:07.683219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:07.751283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:07.843545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc8551-b165-4eab-bc94-233e569906e8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:07.860925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052b61b-dc09-42bf-9b2b-7c62f40d525c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:07.879120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:07.879754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.880033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.880307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.891328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:07.892851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:07.897188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:07.907676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:07.908562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:07.908764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:07.914555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:07.915381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:07.915381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:07.915381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:07.915550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:07.915550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:07.915671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 238/491] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:07.915671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:07.924225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:07.932081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:07.932959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:07.933827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:07.935812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 254/492] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:07.936837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.011616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.027538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91106ea9-8942-45c2-8156-0f8cf5c2a93d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.050896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781298d0-6459-4ad3-9131-e267234e253b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.063957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.064582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.064979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.065253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.076267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:08.081451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:08.082624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:08.083441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 239/493] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:08.084791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.091697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.092317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.092598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.092867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.093742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:08.094077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.095474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.108162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 255/494] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:08.109004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.159802 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.204648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a261e1-ebc2-498f-a7e6-ae3345482042 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.218257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d69d9-8224-4d6e-9eca-8f484839c93b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.242170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.242878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.243164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.243446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.244107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:08.244415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.245880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.254144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 240/495] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:08.258848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.259757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.260402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.260684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.260952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.268245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.272528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:08.278406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:08.285270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 256/496] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:08.286088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.363742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16179-05f1-4e90-a46c-6c20f7a1e55f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.385571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de5798-e4c7-42f7-81b1-2b7baaa0c667 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.394258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.395598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.396202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.396481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.396754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.397402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:08.397705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.400165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.407907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 241/497] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:08.408683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.423688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.424514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.424799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.425072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.432660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.434124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:08.447120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:08.448239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 15:51:08.449330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:08.450200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 257/498] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:08.451023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.475279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.508642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fd488-b7cd-4edd-93e3-c499be898104 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.542103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be34953-467d-4d52-b256-30c541212389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.542724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34953-467d-4d52-b256-30c541212389 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.543001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34953-467d-4d52-b256-30c541212389 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.543274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34953-467d-4d52-b256-30c541212389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.551494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a031-cfd3-4c85-b018-dbf9b34e9c72 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.553296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be34953-467d-4d52-b256-30c541212389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.554800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be34953-467d-4d52-b256-30c541212389 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0be34953-467d-4d52-b256-30c541212389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:08.568313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:08.569357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:08.571031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:08.571031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:08.571031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:08.571031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 242/499] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:08.571031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b4447-0b64-4712-89e6-c4ebf5a00bc9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.571496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b4447-0b64-4712-89e6-c4ebf5a00bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.571588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b4447-0b64-4712-89e6-c4ebf5a00bc9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.576791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 243/500] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:08.576791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b4447-0b64-4712-89e6-c4ebf5a00bc9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.587488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.588103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.588388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.588662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.589340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:08.589632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.591025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.599330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 258/501] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:08.600155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.631533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.677387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b4447-0b64-4712-89e6-c4ebf5a00bc9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.697429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.703348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aeb54-f17b-4205-bb62-1d999bc348d0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.713417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.714093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.714375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.714646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.726455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.728427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.742833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75454-23f1-4643-af4e-9c79da439b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.743444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75454-23f1-4643-af4e-9c79da439b32 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:08.743659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:08.744640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:08.745492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:08.745492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:08.745492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:08.745652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75454-23f1-4643-af4e-9c79da439b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.745652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75454-23f1-4643-af4e-9c79da439b32 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.745652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75454-23f1-4643-af4e-9c79da439b32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:08.746317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 244/502] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:08.746388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75454-23f1-4643-af4e-9c79da439b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.746455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.746520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d75454-23f1-4643-af4e-9c79da439b32 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.783650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 259/503] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:08.784873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fe26-9e6f-4476-b732-19072238d3d3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.785171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fe26-9e6f-4476-b732-19072238d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.785506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1fe26-9e6f-4476-b732-19072238d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.803358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a1a1fe26-9e6f-4476-b732-19072238d3d3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:08.805149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a1a1fe26-9e6f-4476-b732-19072238d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:08.847555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc98c3-38fe-4a11-8b92-00fe8eadac7e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:08.870897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 260/504] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:08.871731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fe26-9e6f-4476-b732-19072238d3d3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.884481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:08.885093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:08.885378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:08.885656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:08.886334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:08.886645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:08.888027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:08.891321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.901094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 245/505] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:08.902014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:08.935232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:08.977919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1fe26-9e6f-4476-b732-19072238d3d3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.008416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34adfa7-f1ed-4550-97dd-7a5a22e43ac5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.014379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.015011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.015293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.015569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.027545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.029005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:09.044803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:09.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:09.046614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:09.046614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:09.046614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:09.046778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.046778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.046778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.046778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.047481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:09.047481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.048764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.050590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 261/506] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:09.051779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.066038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 246/507] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:09.066781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.131638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.163387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7137be-488e-4fb2-bcbe-353da6cbe8fb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.164422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.172666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d341cf0-7a12-4bc8-98a2-4006f7cb2193 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.198131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.198666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.198954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.199235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.206621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.207493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.207770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.208036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.214986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.216428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:09.229073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:09.229999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:09.230900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 247/508] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:09.235476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.266114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.267583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.331850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311eea7-ec34-4b11-ad4a-8450d5ad968c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.333579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.365458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.366088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.366205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 262/509] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:09.366374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.367309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.367734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.367964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:09.368292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.369666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.381330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 248/510] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:09.382176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.399356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.466094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756516-9850-4374-a51b-dd8ee95d102b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.483932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d705dc-9757-4b89-94bc-df3026d44c4a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.501121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.501750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.502062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.502338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.509231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.510712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.517102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.517720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.518033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.518307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:09.521979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:09.522973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:09.523886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 263/511] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:09.524454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.531694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.533131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:09.548397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:09.549281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:09.550630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:09.550630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:09.550630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:09.550630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 249/512] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:09.550630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.560448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.611426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.629564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7b97-206b-4bf2-9a9f-0d12e8007f1e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.650508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59cda8-080e-4dcf-a7d6-c2cf43d78f48 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.663239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.664445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.664719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.664992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.665702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:09.666035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.667450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.683869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 264/513] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:09.684107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.684651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.684749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.685010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.685286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.695962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.697447 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:09.712202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:09.713091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:09.714317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:09.714317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:09.714317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:09.714317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 250/514] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:09.714317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.779551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.791380 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0167-a01e-47cf-9763-93340f13a3e5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.815619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7103f-cd0c-4bc8-97b2-1b32cc03c76e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.825091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.825724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.826034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.826314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.832091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:09.833923 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.835448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:09.847002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:09.848086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 265/515] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:09.849153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.852993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.853754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.854143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.854483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.855283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:09.855660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.857161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.894232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 251/516] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:09.895152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:09.950135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad924689-26b7-4ce8-bb86-60036c3a1df5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.983764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:09.984303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:09.984589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:09.984867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:09.985511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:09.985962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:09.987345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:09.993049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614db24-0966-49a2-9c3e-9c06f9340d33 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:09.999307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 266/517] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:10.000103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.011296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.027767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.028369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.028648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.028922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.070962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.095646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.097118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.098107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520720e0-c56f-400a-a18c-70273c75b3a1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.131665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.132387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.132740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.132955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.133587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:10.133924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.137600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.147437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 267/518] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:10.148312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.197502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 252/519] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:10.198755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.215433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.249698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d0d6-a6b7-45c6-be67-e7c3682b3c9a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.274673 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.282622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.283350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.283633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.283905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.284616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:10.284920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.286378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.301066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a89e0-7cb7-419d-9a07-12b72d926130 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.303585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 268/520] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Oct 3 15:51:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:10.304951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.337468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.338105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.338389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.338661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.402804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857e7fa-524e-4f6b-b813-d5793175267d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.405202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.406721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.428933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.437572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.438232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.438520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.438793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.439438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.440864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.480089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.504058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 253/521] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:10.504802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.559334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 269/522] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:51:10 2022] POST /identity/v3/users => generated 247 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:10.560150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.609889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df623169-c84f-4ea3-ad11-2c7c7bddb428 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.648754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.649650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.650047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.650415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.658076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.659708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:10.673892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:10.674989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:10.676051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:10.676588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9324920-e1da-49da-816d-67d887b93e44 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.682276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 254/523] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:10.682276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.723202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.724645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.725293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.725576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.725941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.739350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.740811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:10.756940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:10.758772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:10.759750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:10.759750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:10.759750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:10.759750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 270/524] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:10.759750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.799595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:10.803868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536be87-036a-4900-8e3c-2776c2facb33 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.840316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.840941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.841201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.841469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.871176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a50df0-90f5-4ec2-b3da-905432a3a303 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:10.908019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:10.908643 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:10.908922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:10.909196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:10.919686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.920526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:10.921127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.922603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:10.936864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:10.937935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:10.939073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:10.939073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:10.939073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:10.942344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 271/525] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:10.943166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:10.965749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.031425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.040253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 255/526] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:11.041419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.049960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93358a30-8104-40a2-b526-b2433a3a7f96 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.087815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.088809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.089087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.089365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.090094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:11.090799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.092233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.115855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 272/527] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:11.115855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.164283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792a7cb-6138-45dd-9136-c449dea977ff None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.203031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.204318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.204802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.205223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.206387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:11.206841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.209244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.211801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.224078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 256/528] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:11.225245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.234544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19043a-ee51-4cd3-ba1c-d87f676d33e1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.272429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973407db-0b96-4692-aad7-8218233797fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.273865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973407db-0b96-4692-aad7-8218233797fa None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.274310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973407db-0b96-4692-aad7-8218233797fa None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.274586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973407db-0b96-4692-aad7-8218233797fa None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.275251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973407db-0b96-4692-aad7-8218233797fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:11.275545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973407db-0b96-4692-aad7-8218233797fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.277097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973407db-0b96-4692-aad7-8218233797fa None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.290097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 273/529] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:11.290926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973407db-0b96-4692-aad7-8218233797fa None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.299904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.338426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e75a3-a164-44eb-8223-b7d43b96bfbc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.373607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.374267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.374550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.374821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.385553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.394148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.399364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973407db-0b96-4692-aad7-8218233797fa None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:11.403214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:11.404289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:11.405128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:11.405128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:11.405128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:11.405128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 257/530] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:11.405128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.439675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.440510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.441023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.441608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.442371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=31f9685c8b244249b2d29f4612a3e5b1) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:11.442688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.444114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.457784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 274/531] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/role_assignments?user.id=31f9685c8b244249b2d29f4612a3e5b1&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:11.457784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.464458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.543458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a181c7-7875-4a1a-ba7c-fe22e234adbf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.547816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.584012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f72756-ca5d-411b-86a2-57ea27c2efc4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.594446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.595236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.595967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.596344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.606625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.608888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:11.625291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:11.626304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:11.627194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:11.631672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 258/532] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:11.633960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.634226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.635089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.635589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.636054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.649684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.652272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:11.673476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:11.675141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:11.676757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:11.682075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 275/533] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:11.683616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.793083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728c2a-41ac-4a12-bdee-5c456fc29e8f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.808668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.856630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3fc3a-fb78-43db-8893-6476bed68791 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:11.858922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.860575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.860945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.861294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.862051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:11.862431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.863892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.884968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 259/534] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:11.884968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:11.892787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:11.899377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:11.899995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:11.900421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:11.900702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:11.901461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:11.901801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:11.906328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:11.917666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 276/535] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:11.918530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:12.002039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3035e-fb1e-4ed8-a03e-3ab78c1ffb32 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:12.038412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0135da-7ff8-4803-9c80-d20d2148d9e8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:12.044914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:12.045523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.045843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.046122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.046815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:12.047122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:12.049215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:12.075586 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 260/536] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:12.076489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:12.077937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:12.078722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.079105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.079481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.091134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:12.092576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:12.106683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:12.107575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:12.109173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:12.112480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 277/537] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:12.113323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:12.115061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:12.172592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:12.220740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd39f-cb4f-4c4d-8a40-a62c07b35513 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:12.229263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123032e-9989-4073-aaed-5cb0ce3e48dd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:12.267326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:12.268040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.268325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.268602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.269152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:12.269354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=bf531e7741af49f091e1116ec1c6751c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:12.269698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:12.270379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.270853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.271175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:12.271543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.272524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=5550726a2c5e4aff9c16f509a3d1bb0a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:12.273308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:12.275574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:12.278016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 278/538] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:12 2022] GET /identity/v3/role_assignments?user.id=bf531e7741af49f091e1116ec1c6751c&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:12.278829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:12.284282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 261/539] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:12 2022] GET /identity/v3/role_assignments?user.id=5550726a2c5e4aff9c16f509a3d1bb0a&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:12.409043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cba8c-5abb-4793-bdc8-dcedb84ac23e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:12.427340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:12.461909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e71f8b-62af-49af-898d-1f453a6918e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:12.462554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e71f8b-62af-49af-898d-1f453a6918e1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.462841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e71f8b-62af-49af-898d-1f453a6918e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.463119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e71f8b-62af-49af-898d-1f453a6918e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.463840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e71f8b-62af-49af-898d-1f453a6918e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:12.464152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e71f8b-62af-49af-898d-1f453a6918e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:12.465808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e71f8b-62af-49af-898d-1f453a6918e1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:12.486357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 279/540] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:12.493372 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:12.640367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:12.650667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeae5b-611d-4249-83ee-7bc3cfaf49c5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:12.700492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a112188-68ec-4a4a-8102-91dbe20d89f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:12.701038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a112188-68ec-4a4a-8102-91dbe20d89f8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.701319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a112188-68ec-4a4a-8102-91dbe20d89f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.701648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a112188-68ec-4a4a-8102-91dbe20d89f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.702443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a112188-68ec-4a4a-8102-91dbe20d89f8 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=8869c7baa4124705bcb3a8c835f566a6) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:12.702776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a112188-68ec-4a4a-8102-91dbe20d89f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:12.704232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a112188-68ec-4a4a-8102-91dbe20d89f8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:12.714651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 262/541] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:12 2022] GET /identity/v3/role_assignments?user.id=8869c7baa4124705bcb3a8c835f566a6&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:12.821464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a58ab9-0a82-462a-b0a1-d3c74dbf1740 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.821850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a58ab9-0a82-462a-b0a1-d3c74dbf1740 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.822070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a58ab9-0a82-462a-b0a1-d3c74dbf1740 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.823524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 280/542] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:12.829318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887583e-dd01-4861-adb4-7e3bb8f6cd66 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:12.829820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887583e-dd01-4861-adb4-7e3bb8f6cd66 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:12.829927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887583e-dd01-4861-adb4-7e3bb8f6cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:12.851737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b887583e-dd01-4861-adb4-7e3bb8f6cd66 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:12.852997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b887583e-dd01-4861-adb4-7e3bb8f6cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:12.948093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 263/543] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:13.227497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a58ab9-0a82-462a-b0a1-d3c74dbf1740 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:13.354480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a58ab9-0a82-462a-b0a1-d3c74dbf1740 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:13.408948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:13.409599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:13.409912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:13.410189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:13.425898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:13.432061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:13.432964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:13.434368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 281/544] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:13.439066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887583e-dd01-4861-adb4-7e3bb8f6cd66 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:13.567600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:13.590780 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887583e-dd01-4861-adb4-7e3bb8f6cd66 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:13.644303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:13.644914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:13.645189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:13.645459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:13.646153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:13.646455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:13.647867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:13.661388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 264/545] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:13.667430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:13.744348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:13.847150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d0bcf-d82f-4265-9c2d-e76c8e56639d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:13.903842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f50a32-e918-4e76-91e9-c724c25073a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:13.904480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f50a32-e918-4e76-91e9-c724c25073a9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:13.904759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f50a32-e918-4e76-91e9-c724c25073a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:13.905036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f50a32-e918-4e76-91e9-c724c25073a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:13.925424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f50a32-e918-4e76-91e9-c724c25073a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:13.926936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f50a32-e918-4e76-91e9-c724c25073a9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-71f50a32-e918-4e76-91e9-c724c25073a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:13.946106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:13.947896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:13.949057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:13.949057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:13.949057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:13.949057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 282/546] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:13.952788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:14.102045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63318c9f-0461-47c9-a58a-10db87ef8379 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:14.111163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf469a-e30f-4415-99f2-524662ddd24c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:14.111449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf469a-e30f-4415-99f2-524662ddd24c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:14.111723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf469a-e30f-4415-99f2-524662ddd24c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:14.113280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 283/547] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:14.119773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e500-28ef-45e4-94ef-17c394f4ad14 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:14.120048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e500-28ef-45e4-94ef-17c394f4ad14 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:14.120320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e500-28ef-45e4-94ef-17c394f4ad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:14.153851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3885e500-28ef-45e4-94ef-17c394f4ad14 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:14.155037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3885e500-28ef-45e4-94ef-17c394f4ad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:14.158797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:14.159399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:14.159676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:14.159944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:14.160575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:14.160875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:14.162253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:14.183836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 265/548] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:14.190466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:14.205384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:14.295594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 284/549] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:14.365863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfab98-f6c1-4995-83f1-94fbe88c263b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:14.419820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:14.420456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:14.420740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:14.421012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:14.434831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:14.436291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:14.449197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:14.450227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:14.451145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 266/550] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:14.458100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e500-28ef-45e4-94ef-17c394f4ad14 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:14.477026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:14.568471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e500-28ef-45e4-94ef-17c394f4ad14 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:14.614664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:14.615612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:14.616123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:14.617341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:14.618284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:14.618769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:14.620624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:14.626421 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:14.643315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 285/551] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Oct 3 15:51:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:14.650457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:14.758177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:14.774948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:14.798392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7fc58-6f3a-493d-bb28-6588b9415b37 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:14.815694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd9a5b-5fb7-4f6b-839d-1e959b76d0e4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:14.837603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:14.838590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:14.838884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:14.839164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:14.851990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:14.857409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:14.858429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:14.859245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 267/552] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:14.867168 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:14.901150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3b5b0-9f0f-4b14-aa29-34ea702d70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:14.901894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b5b0-9f0f-4b14-aa29-34ea702d70d9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:14.902186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b5b0-9f0f-4b14-aa29-34ea702d70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:14.902465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b5b0-9f0f-4b14-aa29-34ea702d70d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:14.988537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3b5b0-9f0f-4b14-aa29-34ea702d70d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:14.994483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3b5b0-9f0f-4b14-aa29-34ea702d70d9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.053020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096542f6-0323-4127-98cf-406b25699e52 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.084694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.090977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5feb5-4797-42d2-8861-0b89715326bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.091582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5feb5-4797-42d2-8861-0b89715326bb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.091901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5feb5-4797-42d2-8861-0b89715326bb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.092176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5feb5-4797-42d2-8861-0b89715326bb None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.092839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5feb5-4797-42d2-8861-0b89715326bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:15.093141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5feb5-4797-42d2-8861-0b89715326bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:15.094606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5feb5-4797-42d2-8861-0b89715326bb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.103750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.104181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 268/553] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:15.105405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68671b-2fe7-493c-af3a-cda450e116c8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.105689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68671b-2fe7-493c-af3a-cda450e116c8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.108193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68671b-2fe7-493c-af3a-cda450e116c8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.108193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 269/554] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:15.109329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68671b-2fe7-493c-af3a-cda450e116c8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.125286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 286/555] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:15.127072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e315570-846b-4efa-a95b-add42d0bda53 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.127620 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e315570-846b-4efa-a95b-add42d0bda53 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.127903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e315570-846b-4efa-a95b-add42d0bda53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.150066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2e315570-846b-4efa-a95b-add42d0bda53 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:15.151567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2e315570-846b-4efa-a95b-add42d0bda53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:15.224734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68671b-2fe7-493c-af3a-cda450e116c8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.236310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 287/556] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:15.237711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e315570-846b-4efa-a95b-add42d0bda53 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.278338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.279354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.279850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.280416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.306432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:15.308476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:15.337589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:15.338602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:15.339568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:15.339568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:15.339568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:15.348908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 270/557] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:15.354599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.359598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e315570-846b-4efa-a95b-add42d0bda53 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.361945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.401007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36255d46-82f7-4da1-b8a6-9bb6cefbad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.401573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255d46-82f7-4da1-b8a6-9bb6cefbad91 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.401897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255d46-82f7-4da1-b8a6-9bb6cefbad91 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.402173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36255d46-82f7-4da1-b8a6-9bb6cefbad91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.414447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255d46-82f7-4da1-b8a6-9bb6cefbad91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:15.416031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36255d46-82f7-4da1-b8a6-9bb6cefbad91 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-36255d46-82f7-4da1-b8a6-9bb6cefbad91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:15.438421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:15.439880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:15.440757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:15.440757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:15.440757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:15.440757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 288/558] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:15.441444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab535-e4da-43bb-b815-bf902b25b0cd None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.442817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab535-e4da-43bb-b815-bf902b25b0cd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.442817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ab535-e4da-43bb-b815-bf902b25b0cd None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.443931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 289/559] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:15.446349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.448081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ab535-e4da-43bb-b815-bf902b25b0cd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.515232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319566-9c3b-4009-8d91-3f60cd633f65 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.557068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cc80a-20cc-4d37-abcf-74f5e16116bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.557785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc80a-20cc-4d37-abcf-74f5e16116bb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.558169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc80a-20cc-4d37-abcf-74f5e16116bb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.558520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cc80a-20cc-4d37-abcf-74f5e16116bb None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.559433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cc80a-20cc-4d37-abcf-74f5e16116bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:15.559551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cc80a-20cc-4d37-abcf-74f5e16116bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:15.561012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cc80a-20cc-4d37-abcf-74f5e16116bb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.568980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ab535-e4da-43bb-b815-bf902b25b0cd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.577559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 271/560] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:15.577559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bffa4-fd91-4afa-b078-d2c6271ad471 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.577559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bffa4-fd91-4afa-b078-d2c6271ad471 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.577559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bffa4-fd91-4afa-b078-d2c6271ad471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.593911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-509bffa4-fd91-4afa-b078-d2c6271ad471 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:15.595107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-509bffa4-fd91-4afa-b078-d2c6271ad471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:15.609229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e152add-7781-4e02-8e76-152e18219148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.609864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e152add-7781-4e02-8e76-152e18219148 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.610153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e152add-7781-4e02-8e76-152e18219148 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.610425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e152add-7781-4e02-8e76-152e18219148 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.611070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e152add-7781-4e02-8e76-152e18219148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:15.611373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e152add-7781-4e02-8e76-152e18219148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:15.612729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e152add-7781-4e02-8e76-152e18219148 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.624554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 290/561] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:15.625553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898054c-54b0-4a72-bb2e-5d11c03e5114 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.625868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898054c-54b0-4a72-bb2e-5d11c03e5114 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.626148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898054c-54b0-4a72-bb2e-5d11c03e5114 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.629889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 291/562] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:15.630695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898054c-54b0-4a72-bb2e-5d11c03e5114 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.650463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.670775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 272/563] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:15.671763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bffa4-fd91-4afa-b078-d2c6271ad471 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.705060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.749498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898054c-54b0-4a72-bb2e-5d11c03e5114 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.785126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bffa4-fd91-4afa-b078-d2c6271ad471 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.785705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.786359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.786666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.786969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.795258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:15.796701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:15.810170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:15.811205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 292/564] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:15.812244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.826367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4f0e5-ae98-4552-8366-6cbc7b636468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.826993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f0e5-ae98-4552-8366-6cbc7b636468 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.827275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f0e5-ae98-4552-8366-6cbc7b636468 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.827543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4f0e5-ae98-4552-8366-6cbc7b636468 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.839780 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4f0e5-ae98-4552-8366-6cbc7b636468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8da4f0e5-ae98-4552-8366-6cbc7b636468 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:15.844567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:15.845668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:15.846802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 273/565] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:15.847534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38accfe1-30cd-483e-a7cf-5ee98188b018 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.847534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38accfe1-30cd-483e-a7cf-5ee98188b018 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.847534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38accfe1-30cd-483e-a7cf-5ee98188b018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.865960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-38accfe1-30cd-483e-a7cf-5ee98188b018 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:15.867786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-38accfe1-30cd-483e-a7cf-5ee98188b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:15.904811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.927879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e332142-6fca-42da-9c9e-009f824dec4a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:15.943559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 274/566] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:15.944407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38accfe1-30cd-483e-a7cf-5ee98188b018 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:15.964660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:15.965283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:15.965564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:15.965858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:15.968301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:15.972537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:15.974026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:15.986696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:15.987761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:15.988862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:15.989823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 293/567] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:15.990428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.064543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38accfe1-30cd-483e-a7cf-5ee98188b018 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.099823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a825e-2392-48b2-be8a-c2b83585b773 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.102048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.102655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.102934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.103204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.103922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.104225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.105677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.123922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 275/568] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.125000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.142915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.143566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.143793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.144123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.144778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.145101 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.146493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.149391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.157121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 294/569] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.157777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.211343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.234390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809970b-4fea-4c97-8422-55e8af8c0770 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.258229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289d940-c6eb-4f7d-94b5-6d8056a39554 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.268641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.269260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.269540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.269840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.280074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:16.284794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:16.285719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:16.286611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 276/570] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:16.287317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.293405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.294038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.294320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.294592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.295273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.295578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.296991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.308891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 295/571] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.309672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.369190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.385917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f21564-92ce-4c65-883b-b0f932aa6480 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.411102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3975a8-5d53-48de-ad20-67ac512c1d7c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.419269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.419883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.420173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.420443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.426762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.430900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.432340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.445508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.446166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.446451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.446726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:16.447973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:16.448862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:16.449859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:16.449859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:16.449859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:16.449859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 277/572] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:16.450106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.459761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.461466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:16.475489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:16.476584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:16.477450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:16.477450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:16.477450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:16.477450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 296/573] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:16.477450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.550895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb019d88-87f0-4664-a2e1-1fcc6ea1f61c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.578219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0c56f-8b3e-46d9-80ff-13b16e4ebeb8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.584665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.585451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.586028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.586312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.589169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.596226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:16.601657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:16.602791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 278/574] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:16.603833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.617514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.618188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.618771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.619053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.619717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.620024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.621439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.629295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 297/575] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.630111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.657776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.707935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042eb81-7cc2-4877-9428-d3ad90ff9fae None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.733212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4407aec-5ae5-4cec-a9c8-2815b79f541c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.741170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.742348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.742641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.742915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.743637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a21de1ac06b8422fa33aae8a1ad4bcf2) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.743950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.745373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.750882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 279/576] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/role_assignments?user.id=a21de1ac06b8422fa33aae8a1ad4bcf2&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.751658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.768908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.769541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.769930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.770214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.770888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.771200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.772698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.786412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 298/577] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.787364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.828652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.869460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52e511-af2e-43ef-9f04-47014af9d62c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.885910 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:16.908133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73800429-24d6-4ee9-9aee-de248b8d3ec3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:16.908352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.908934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.909283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.909630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.910390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.910696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.912106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.926351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 280/578] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.927199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:16.950747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:16.951493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:16.951875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:16.952250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:16.953025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:16.953421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:16.954942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:16.963658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 299/579] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:16.964572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.043492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c04cb-f966-49b6-85d7-d9aa40e2542a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.069641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.076998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b54b3-7661-415f-9a81-9069770f6820 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.080102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.080740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.081064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.081341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.092514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.094031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:17.109356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:17.110390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:17.111286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:17.111286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:17.111286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:17.111286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 281/580] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:17.111286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.118781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.119428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.119712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.119989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.127032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.128456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:17.140203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:17.141070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 300/581] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:17.142095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.148210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.228793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5dfe1-3ff7-4bdf-b798-d41bc301ef96 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.252273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac20ea-8e8b-4e26-9f4c-2d016473a890 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.266605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.267234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.267510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.267778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.276201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.277682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:17.291354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:17.292309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 282/582] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:17.293253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.299866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.300441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.300726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.301000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.314053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.315522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:17.330568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:17.331523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:17.332692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:17.332692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:17.332692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:17.332692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 301/583] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:17.332692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.346831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.385703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.402280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63bafc-d257-4bc3-b967-80285c344927 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.439241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.440359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.440952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.441446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.442225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:17.442539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.443623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a2de3-9d53-4f29-8726-924757b75509 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.444058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.456530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 283/584] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:17.457708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.486418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.487028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.487309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.487585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.488275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:17.488591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.490051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.504153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 302/585] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:17.505389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.568909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab9033-0592-48ab-bc4b-b5f3ef8e999f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.574010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.608169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.608773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.609049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.609315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.610099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:17.610468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.611891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae2cfc-9bdc-4e3b-b832-29613d5d8b07 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.612009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.631741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 284/586] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:17.633185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.638261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.656694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.657309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.657595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.657902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.658551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:17.658858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.660230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.676901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 303/587] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:17.676901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.749364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8fee7-d807-4e00-8630-33b65a2a41f6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.789584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e757e59-acc3-4f01-b7b3-61e292435d32 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.792092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.792762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.793045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.793319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.801542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.803059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:17.814946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:17.815964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 285/588] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:17.816981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:17.821389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.831644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.835741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.835741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.835741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/31f9685c8b244249b2d29f4612a3e5b1/roles/1ff414d138e94c31ac02e205bfabb944` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.852414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=31f9685c8b244249b2d29f4612a3e5b1, role_id=1ff414d138e94c31ac02e205bfabb944)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.853920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.886615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:17.924887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8e24f-ff5b-4232-afe1-a6d3b7cd0558 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:17.958179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:17.958810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:17.959091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:17.959365 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:17.970911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:17.972384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:17.987048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:17.988205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:17.989154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:17.989154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:17.989154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:17.989154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 286/589] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:17.989391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.084915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a206e-029e-46c0-b8ea-2fa66ee4e2b3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.114054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 304/590] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:17 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/31f9685c8b244249b2d29f4612a3e5b1/roles/1ff414d138e94c31ac02e205bfabb944 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:51:18.114913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.122951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.123909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.124343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.124892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.134564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.136853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:18.151819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:18.156527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 287/591] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:51:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:18.157666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.171359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:18.231287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea538d5-a7f7-4a32-b196-f5bd7c8a9585 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.275959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd831f-06af-4c53-9540-94f26b466027 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.278142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.278883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.279208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.279481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.280228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:18.280535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.282175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.302877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 305/592] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:18.303736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.314705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.315321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.315603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.315942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.316531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:18.316838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.318245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.334728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 288/593] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:18.335745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.348741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:18.380547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:18.420587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15a1f-0d1d-4508-8d2e-6fe370d09201 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.457983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.459390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.459866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.460589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.461656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:18.462195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.463835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.465984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9994540-da5f-4630-954d-dc7720e8eac7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.483100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 306/594] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:18.484482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.510672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.511315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.511628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.512208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.526071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.527545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:18.546626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:18.547634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:18.548524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:18.548524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:18.548524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:18.548524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 289/595] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:18.549377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.598844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:18.611967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ed587-3d14-4c26-b922-5254277ba2f4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.653666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:18.663614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.668139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.668139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.668139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.668625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628eb68-16fc-4f2f-967c-f0e44d773b1d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.673463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.675403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:18.691188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:18.693207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:18.695828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:18.705793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 307/596] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:18.705793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.706615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.707987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.708278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.708556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.720841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.724501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:18.747542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:18.748706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:18.749892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:18.749892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:18.749892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:18.751353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 290/597] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:18.752174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.829418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22bfd7-afae-4c19-a146-4a90df20342d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.871832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.872452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.872738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.873015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.873662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:18.874000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.875378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.876016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299657e3-b8ad-405d-8861-bc3e8c377e14 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:18.893588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 308/598] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:18.894515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:18.910708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:18.920776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:18.922143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:18.922606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:18.923291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:18.924139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:18.924758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:18.926989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:18.939754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:18.945915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 291/599] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:18.946830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.010487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33ca73-0b51-4407-b1dc-66beaec5ec1a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.049633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43380a5-a4ad-41d0-bbc4-02f09c980f35 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.055880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42015b4-8c0e-43dd-ab13-8e13393b6b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.056497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42015b4-8c0e-43dd-ab13-8e13393b6b6a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.056772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42015b4-8c0e-43dd-ab13-8e13393b6b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.057043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42015b4-8c0e-43dd-ab13-8e13393b6b6a None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.057687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42015b4-8c0e-43dd-ab13-8e13393b6b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:19.058018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42015b4-8c0e-43dd-ab13-8e13393b6b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.059830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42015b4-8c0e-43dd-ab13-8e13393b6b6a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.078816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 309/600] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:19.078816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3c59-368e-4f89-8fcf-c86ce7190ca8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.078816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3c59-368e-4f89-8fcf-c86ce7190ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.078816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3c59-368e-4f89-8fcf-c86ce7190ca8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.081477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 310/601] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:19.082161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3c59-368e-4f89-8fcf-c86ce7190ca8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.097674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.098755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.099201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.099642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.111793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.114258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:19.134604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:19.136462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 292/602] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:19.138349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.184463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:19.200283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:19.222438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3c59-368e-4f89-8fcf-c86ce7190ca8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.244309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c679-4101-4974-b055-8c958b93c058 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.258702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.259363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.259646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.259929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/bf531e7741af49f091e1116ec1c6751c/roles/1ff414d138e94c31ac02e205bfabb944` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.274916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=bf531e7741af49f091e1116ec1c6751c, role_id=1ff414d138e94c31ac02e205bfabb944)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.276367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.277132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e2ba4-856b-4b0a-8b4b-ac61ab43b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.277936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e2ba4-856b-4b0a-8b4b-ac61ab43b359 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.278382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e2ba4-856b-4b0a-8b4b-ac61ab43b359 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.278653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e2ba4-856b-4b0a-8b4b-ac61ab43b359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.285301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e2ba4-856b-4b0a-8b4b-ac61ab43b359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.286844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e2ba4-856b-4b0a-8b4b-ac61ab43b359 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f84e2ba4-856b-4b0a-8b4b-ac61ab43b359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:19.299636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:19.300705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:19.301867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 293/603] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:19.302826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2eb25-8911-4ffb-8ebf-5644b6a6b820 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.302826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2eb25-8911-4ffb-8ebf-5644b6a6b820 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.302826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2eb25-8911-4ffb-8ebf-5644b6a6b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.320628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-57a2eb25-8911-4ffb-8ebf-5644b6a6b820 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:19.321833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-57a2eb25-8911-4ffb-8ebf-5644b6a6b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:19.353497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 311/604] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:19 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/bf531e7741af49f091e1116ec1c6751c/roles/1ff414d138e94c31ac02e205bfabb944 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:51:19.354632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.417877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 294/605] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:19.417877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2eb25-8911-4ffb-8ebf-5644b6a6b820 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.520934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:19.536067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955914b-4e3c-47e5-b6a4-39ef93422858 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.575024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:19.584482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2eb25-8911-4ffb-8ebf-5644b6a6b820 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.589058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.589677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.589992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.590273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.590972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:19.591279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.592707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.609678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 312/606] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:19.617196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.643921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.644534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.644807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.645077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.645795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:19.646100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.647557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.667559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 295/607] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:19.673238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.757887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d841ba0-1f25-4698-becf-052900fdb5ad None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.782654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94a76-682c-4a9c-9cf4-6993dcc2010c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:19.795008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:19.808827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.809939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.810691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.811382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/8869c7baa4124705bcb3a8c835f566a6/roles/1ff414d138e94c31ac02e205bfabb944` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.820833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:19.821494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:19.821789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:19.822076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/5550726a2c5e4aff9c16f509a3d1bb0a/roles/1ff414d138e94c31ac02e205bfabb944` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:19.831110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=8869c7baa4124705bcb3a8c835f566a6, role_id=1ff414d138e94c31ac02e205bfabb944)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.833328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.837590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=5550726a2c5e4aff9c16f509a3d1bb0a, role_id=1ff414d138e94c31ac02e205bfabb944)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:19.839849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:19.936419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 313/608] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:19 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/8869c7baa4124705bcb3a8c835f566a6/roles/1ff414d138e94c31ac02e205bfabb944 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:51:19.937492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:19.978195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 296/609] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:19 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/5550726a2c5e4aff9c16f509a3d1bb0a/roles/1ff414d138e94c31ac02e205bfabb944 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:51:19.983328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:20.074577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccae12-3aa9-492f-b00a-a12ebcc45549 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:20.130411 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:20.131057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:20.131338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:20.131609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:20.154861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:20.159999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:20.161028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:20.161925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 314/610] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:20.175060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:20.346414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8b6a-18fd-4342-b42d-0d42d98eb9ba None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:20.392729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992c98-c3b8-429e-bc0a-9d565c36eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:20.393360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992c98-c3b8-429e-bc0a-9d565c36eb64 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:20.398117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992c98-c3b8-429e-bc0a-9d565c36eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:20.398117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992c98-c3b8-429e-bc0a-9d565c36eb64 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:20.398117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a992c98-c3b8-429e-bc0a-9d565c36eb64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:20.398117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a992c98-c3b8-429e-bc0a-9d565c36eb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:20.398117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a992c98-c3b8-429e-bc0a-9d565c36eb64 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:20.406943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 297/611] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:20.414739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:20.486296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef383c-fd56-4fd1-9456-7291d3f5b624 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:20.486620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef383c-fd56-4fd1-9456-7291d3f5b624 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:20.486866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef383c-fd56-4fd1-9456-7291d3f5b624 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:20.488362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 298/612] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:20.494999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c67cb-5118-4558-8dfd-e2a50a6c6676 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:20.495642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c67cb-5118-4558-8dfd-e2a50a6c6676 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:20.496130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c67cb-5118-4558-8dfd-e2a50a6c6676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:20.518326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:20.526435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7d6d-b1d9-428e-acc7-ca3e5ad91aa3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:20.530877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-979c67cb-5118-4558-8dfd-e2a50a6c6676 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:20.532384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-979c67cb-5118-4558-8dfd-e2a50a6c6676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:20.563294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:20.563962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:20.564273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:20.564556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:20.566146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:20.575632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:20.577119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:20.593997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:20.594997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:20.595876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:20.595876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:20.595876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:20.595876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 315/613] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:20.602822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:20.650033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 299/614] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:51:20.711969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9678-31d5-4723-9d31-80d13629107f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:20.749984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:20.750597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:20.750880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:20.751156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:20.751801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:20.752107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:20.753560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:20.766603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 316/615] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:20.772038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c67cb-5118-4558-8dfd-e2a50a6c6676 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:20.930167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c67cb-5118-4558-8dfd-e2a50a6c6676 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:20.983675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:20.984325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:20.984610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:20.984888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:20.997716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:20.999211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:21.015294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:21.016289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:21.017213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 300/616] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:21.024571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:21.029629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:21.099642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:21.127672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:21.203412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd70cd6-22a9-4b74-9fc8-7aeccc9f14c1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:21.253788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:21.254398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:21.254680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:21.254958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:21.255683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:21.255994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:21.258148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:21.285476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 317/617] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Oct 3 15:51:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:21.294829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e861cdb-cebd-4b13-a727-7ed22a4a1441 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:21.298510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:21.365152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:21.365819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:21.366107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:21.366452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:21.382822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:21.388205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:21.389293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:21.390407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:21.391864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 301/618] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:21.396235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:21.414244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:21.482157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88968b15-dccd-49e6-847f-10fd804a903f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:21.529531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:21.535069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:21.535714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:21.536358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:21.536358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:21.558328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:21.559797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:21.579882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:21.581325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:21.582228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:21.582228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:21.582228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:21.587037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6f005-4e2b-413e-9f96-8415567419bd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:21.590206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 318/619] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:21.590398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:21.648605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:21.649217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:21.649501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:21.649794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:21.650469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:21.650776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:21.652149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:21.672483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 302/620] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:21.676786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:21.790538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9bd1-d671-4f3b-8f1d-dbe4ee4c4d47 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:21.816605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:21.856259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:21.856935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:21.857226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:21.857507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:21.858226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:21.858538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:21.859924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:21.876172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d061-daa9-4cbe-88d1-4d0f6d22112a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:21.887288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 319/621] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:21.892389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:21.946655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:21.947301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:21.947649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:21.947931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:21.962104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:21.973403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:21.981045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:21.998439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:21.999395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:22.000275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:22.000275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:22.000275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:22.004124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 303/622] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:22.005324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:22.060136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82555262-bb4d-457f-9087-da80c3d7fe9f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.097280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09f17a-c359-4669-aef1-fe636ef249d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.097949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f17a-c359-4669-aef1-fe636ef249d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.098238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f17a-c359-4669-aef1-fe636ef249d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.098517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09f17a-c359-4669-aef1-fe636ef249d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.106344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09f17a-c359-4669-aef1-fe636ef249d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:22.107822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09f17a-c359-4669-aef1-fe636ef249d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4f09f17a-c359-4669-aef1-fe636ef249d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:22.120454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:22.121384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:22.122301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 320/623] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:22.123594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a125-43d4-48ed-86d5-b070574aaaae None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.123883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a125-43d4-48ed-86d5-b070574aaaae None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.124447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a125-43d4-48ed-86d5-b070574aaaae None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.125976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 321/624] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:22.126901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a125-43d4-48ed-86d5-b070574aaaae None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:22.134275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bef07-e4c8-4e07-81af-65540c100256 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.170863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:22.180244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f8115-c362-474c-bd6f-b59596f790ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.180862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8115-c362-474c-bd6f-b59596f790ec None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.186982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8115-c362-474c-bd6f-b59596f790ec None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.186982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8115-c362-474c-bd6f-b59596f790ec None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.186982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f8115-c362-474c-bd6f-b59596f790ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:22.186982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f8115-c362-474c-bd6f-b59596f790ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:22.186982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f8115-c362-474c-bd6f-b59596f790ec None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:22.201541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 304/625] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:22.202888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bf26b-ad67-438b-b82d-36dfaff90262 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.203173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bf26b-ad67-438b-b82d-36dfaff90262 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.203455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bf26b-ad67-438b-b82d-36dfaff90262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.224301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5e0bf26b-ad67-438b-b82d-36dfaff90262 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:22.225581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e0bf26b-ad67-438b-b82d-36dfaff90262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:22.247979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a125-43d4-48ed-86d5-b070574aaaae None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.273823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:22.285827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.298241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.298241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.298241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.298241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:22.298241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:22.298241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:22.307057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 305/626] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:22.307057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bf26b-ad67-438b-b82d-36dfaff90262 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:22.309081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 322/627] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:22.314689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:22.414079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bf26b-ad67-438b-b82d-36dfaff90262 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.453277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.454067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.454302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.454579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.462948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:22.464828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:22.470930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:22.478504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca96f6-6e58-4693-a4ac-a173a8f77808 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:22.478706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:22.479618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 15:51:22.480656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:22.484264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 306/628] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:22.486334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:22.524142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1b17-56cd-4a11-b182-b887d9b956a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.525159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1b17-56cd-4a11-b182-b887d9b956a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.525651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1b17-56cd-4a11-b182-b887d9b956a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.526146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1b17-56cd-4a11-b182-b887d9b956a6 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a21de1ac06b8422fa33aae8a1ad4bcf2/roles/1ff414d138e94c31ac02e205bfabb944` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.527740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:22.542496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1b17-56cd-4a11-b182-b887d9b956a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=a21de1ac06b8422fa33aae8a1ad4bcf2, role_id=1ff414d138e94c31ac02e205bfabb944)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:22.544218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1b17-56cd-4a11-b182-b887d9b956a6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:22.617282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 323/629] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:22 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a21de1ac06b8422fa33aae8a1ad4bcf2/roles/1ff414d138e94c31ac02e205bfabb944 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:51:22.618732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b598fe-8c81-416e-8c84-31fc8e7afef8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.619016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b598fe-8c81-416e-8c84-31fc8e7afef8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.619312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b598fe-8c81-416e-8c84-31fc8e7afef8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.620816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 324/630] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:22.630055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20caa8-6880-412e-9b21-e32d7724f361 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.630055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20caa8-6880-412e-9b21-e32d7724f361 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.630055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20caa8-6880-412e-9b21-e32d7724f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.634295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afc343-8db0-42a8-860d-78ce1ca02229 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.650919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-dd20caa8-6880-412e-9b21-e32d7724f361 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:22.651526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dd20caa8-6880-412e-9b21-e32d7724f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:22.718038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.720050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.720376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.720651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.722614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:22.722938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:22.724490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:22.758399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 307/631] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Oct 3 15:51:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:22.759134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:22.774318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 325/632] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:51:22.779096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20caa8-6880-412e-9b21-e32d7724f361 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:22.878706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:22.880100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:22.893832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37232ae-a0c5-4805-9816-4181483240b4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.923114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20caa8-6880-412e-9b21-e32d7724f361 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:22.925611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a3755-7538-4a34-809c-9f93650751bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.926320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a3755-7538-4a34-809c-9f93650751bb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.926569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a3755-7538-4a34-809c-9f93650751bb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.926845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a3755-7538-4a34-809c-9f93650751bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.937574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a3755-7538-4a34-809c-9f93650751bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-775a3755-7538-4a34-809c-9f93650751bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:22.942734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:22.943861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:22.945257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 308/633] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:22.946137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4463e-fadd-453f-ba93-e24d01789f02 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.946137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4463e-fadd-453f-ba93-e24d01789f02 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.950898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4463e-fadd-453f-ba93-e24d01789f02 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.950898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 309/634] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:22.953211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43ff73-0e61-4264-bd3d-75e5d6bd9bed None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.953501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43ff73-0e61-4264-bd3d-75e5d6bd9bed None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.953789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43ff73-0e61-4264-bd3d-75e5d6bd9bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.970213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:22.970924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:22.971279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:22.971624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:22.979234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8b43ff73-0e61-4264-bd3d-75e5d6bd9bed None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:22.980636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8b43ff73-0e61-4264-bd3d-75e5d6bd9bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:23.060517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.062536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.071195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 310/635] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:51:23.072320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43ff73-0e61-4264-bd3d-75e5d6bd9bed None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.158182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:23.167499 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:23.184301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43ff73-0e61-4264-bd3d-75e5d6bd9bed None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.190978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 326/636] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:23.192382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.222408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.223388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.223869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.224340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.225217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:23.225788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.227363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.239816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 311/637] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:23.243245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.322528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bae78a-c251-4831-89b2-1f27f0a80643 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.364682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9567faa-911b-4114-833c-0ee3d23c04e0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.386729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.387974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.388596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.389398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.400470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.401106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.401403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.401656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.407000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:23.413026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:23.413839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:23.414942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:23.416488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:23.417161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.417234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 327/638] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:23.417234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.422218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:23.431083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:23.432090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:23.433441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:23.433441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:23.433441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:23.433441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 312/639] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:23.434140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.463111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:23.534190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6fcb-bec3-4e28-8f55-5d30dedb0483 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.544691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1eafa7-970a-44fb-abc0-868119b5188c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.570006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.570726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.571010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.571284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.581334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.581449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.582011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.582296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.582833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.583014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.593334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:23.598605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:23.599542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:23.606064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:23.606725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:23.607657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:23.608574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:23.608574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:23.608574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:23.608759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 313/641] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:23.608831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 328/641] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:23.608831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.608963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.668212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:23.703536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:23.714485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dd152-f63d-4926-aaef-21905ede4cce None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.724590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287f3c1-daa2-4f9c-a70e-30ec9b6c7075 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.760483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.761119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.761401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.761666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.762364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:23.762671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.764053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.766578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.767208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.767491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.767763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.768402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:23.768709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.770080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.772584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 314/642] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:23.773528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.791286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 329/643] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:23.791286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.886945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284d73c-07f0-457a-b0a4-2ab52584ef15 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.896349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96118391-ae63-42dc-9571-70f23e2160cd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:23.907666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:23.922201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.922806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.923085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.923359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.924101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:23.924406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.925797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.934400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 315/644] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:23.935188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.939941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:23.940560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:23.940846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:23.941125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:23.941850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:23.942107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:23.943525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:23.962584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 330/645] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:23.962584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:23.970009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.045951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42828e90-be20-44b1-acf2-f5a17eaca2e7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.077180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69280b-f249-47d7-9fb5-28b254f9bc9a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.083437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.084069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.084468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.084746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.096367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.098380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.113669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:24.113850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:24.114958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:24.116798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:24.116798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:24.116798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:24.117009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.117009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.117009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.117965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 316/646] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:24.118843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.128763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.130264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:24.143959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:24.145022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:24.146197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:24.149903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 331/647] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:24.151490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.162395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.220982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.229118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a9f0-5259-4001-8dea-949f60016f8a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.260221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facc0c8-e1fa-4736-809a-478170a250e1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.264599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.265233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.265514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.265810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.275969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.277420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:24.292869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:24.294000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:24.294905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:24.294905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:24.294905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:24.294905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 317/648] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:24.294905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.301318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.302000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.302289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.302564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.311845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.313287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:24.324779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:24.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:24.326754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 332/649] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:24.327362 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.397634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.410503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde5cf5-1c98-4c46-a661-c312bb7fb65e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.438215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcecf7-1edc-4e8c-961b-0be909ce573d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.447056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.447676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.447964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.448269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.448911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:24.449223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.450628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.462372 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 318/650] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:24.463195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.475028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.485503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.487645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.487645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.487645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.487645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:24.487924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.489224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.504122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 333/651] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:24.504952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.576594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617f70-082f-499b-a4d5-3e0449bcc3c2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.612900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8a61c-1680-48b5-abac-08a578d7a082 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.613380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.614107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.614404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.614660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.615303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:24.615603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.617649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.630064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 319/652] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:24.631174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.640475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.656511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.657519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.658304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.658755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.659934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:24.660507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.662168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.689373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 334/653] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:24.691193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.739896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b975244-20eb-4333-b079-6c6175a12f72 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.750035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.778398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.779030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.779313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.779590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.787301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.789107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:24.801114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:24.802279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:24.803261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 320/654] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:24.804529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.820092 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2253d-2873-43b1-8219-8fa2d1716eb5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.858563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.859177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.859464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.859743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.860470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=31f9685c8b244249b2d29f4612a3e5b1) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:24.860784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.862250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.868659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 335/655] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/role_assignments?user.id=31f9685c8b244249b2d29f4612a3e5b1&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:24.869298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:24.891292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:24.934099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6aace-e157-4b96-871d-6020b1cdb665 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.974239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:24.974889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:24.975170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:24.975472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:24.983732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:24.985222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:24.995278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fba94-111d-47c8-bbbd-6ebf29bc13d5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:24.998145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:24.999287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:25.000294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 321/656] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:25.000907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.012417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.041711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.042631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.042919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.043194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.126963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500621d-4264-4407-8935-39cc8942f13e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:25.130482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.131997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:25.155294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.164657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d55a2-47bf-4b49-854c-3054007b9ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.165296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d55a2-47bf-4b49-854c-3054007b9ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.165574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d55a2-47bf-4b49-854c-3054007b9ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.165875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d55a2-47bf-4b49-854c-3054007b9ac3 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.166596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d55a2-47bf-4b49-854c-3054007b9ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:25.166898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d55a2-47bf-4b49-854c-3054007b9ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.168323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d55a2-47bf-4b49-854c-3054007b9ac3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:25.191527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 322/657] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:25.191527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c25f65-e04b-45dd-9c0b-6cd90e2b5158 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.191527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c25f65-e04b-45dd-9c0b-6cd90e2b5158 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.191527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c25f65-e04b-45dd-9c0b-6cd90e2b5158 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.191527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 323/658] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:25.191527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c25f65-e04b-45dd-9c0b-6cd90e2b5158 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.258489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 336/659] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:25.258489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.267948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.299951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c25f65-e04b-45dd-9c0b-6cd90e2b5158 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:25.338017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1ec4a-1d6b-4460-a874-2730e0c800c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.338635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1ec4a-1d6b-4460-a874-2730e0c800c3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.338916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1ec4a-1d6b-4460-a874-2730e0c800c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.339191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1ec4a-1d6b-4460-a874-2730e0c800c3 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.339917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1ec4a-1d6b-4460-a874-2730e0c800c3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:25.340223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1ec4a-1d6b-4460-a874-2730e0c800c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.341649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1ec4a-1d6b-4460-a874-2730e0c800c3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:25.363551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 324/660] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Oct 3 15:51:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:25.363551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9805-8ff2-4af2-a788-cd49cb733665 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.363551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9805-8ff2-4af2-a788-cd49cb733665 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.363551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a9805-8ff2-4af2-a788-cd49cb733665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.374603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82c150-2002-451a-be57-411ecafff647 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:25.379164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b04a9805-8ff2-4af2-a788-cd49cb733665 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:25.380354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b04a9805-8ff2-4af2-a788-cd49cb733665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:25.416567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.417177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.417456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.417728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.418213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.458051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 325/661] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:25.458051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a9805-8ff2-4af2-a788-cd49cb733665 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.497140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.499079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:25.511126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.591646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a9805-8ff2-4af2-a788-cd49cb733665 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:25.614561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 337/662] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:25.615641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.633675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.634706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.635257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.635532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.649363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.651311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:25.671043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:25.672033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:25.672921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:25.672921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:25.672921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:25.672921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 326/663] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:25.673957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.706012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.738591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3c2af-4d8b-44b3-a694-64b4c405500f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:25.748152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.777048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.778190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.778477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.778753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.790481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56eb0-e714-4680-a07f-d46c1b07b550 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:25.826338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.826969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.827255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.827532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.839518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.841009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:25.857488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:25.858540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:25.859442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:25.859442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:25.859442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:25.859442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 327/664] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:25.859442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.864452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.866166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:25.937024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.961061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ae484-fe43-4a70-83dd-a793b72842a9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:25.981643 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 338/665] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:25.982905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:25.994344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:25.994889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:25.995168 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:25.995441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:25.996103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:25.996403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:25.997384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:25.997800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.010240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 328/666] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:26.011057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.096772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c150a6-0668-4dd7-a66d-95f288e5a5b1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.121138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9458471-c2f3-4423-b621-a466eae39070 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.133141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.133786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.134075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.134346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.145682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:26.152157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:26.153252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:26.154326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:26.155684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 339/667] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:26.156290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.170376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.170980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.171255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.171525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.172158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:26.172453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.174364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.176274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:26.186332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 329/668] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:26.187114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.234583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:26.268425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67c7a5-2767-48c5-8e03-33b9522e065d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.302944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f394-abaa-4826-9ec9-14da89880f55 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.309580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.310234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.310916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.311190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.322563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.324006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.339464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:26.339725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:26.340636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:26.341536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:26.341536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:26.341536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:26.341706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.341706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.341706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.345373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 340/669] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:26.346523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.351896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.352585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:26.364929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:26.365864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 330/670] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:26.367497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.428410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:26.464095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccc02a-c53b-4894-8a7e-8808c98ef94d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.476608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533835e-7c61-4df1-8acb-696a669648d5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.485058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:26.500073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.500682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.500977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.501248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.502014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:26.502322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.503691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.512488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.513112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.513390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.513663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.514324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 341/671] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:26.515192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.525587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.527015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:26.540033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:26.540952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 331/672] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:26.542396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.633500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92f4d6-4899-4dc3-83bb-332d5bb36f49 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.645044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd74b4f-3744-404c-b97c-0705b7bfc9e1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.661664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:26.674024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.674690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.675077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.675235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.675875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:26.676177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.677538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.682112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.682935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.683391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.683840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.684716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:26.685223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.686844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.689218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 342/673] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:26.690770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.706017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 332/674] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:26.707271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.752266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:26.824938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc740c-e4c0-41c9-9bb6-18f5bc2804d0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.825542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8958c3-ac45-4efa-b7fd-d7a3a088a75b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:26.862994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.863243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:26.863598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.863710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:26.863878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.863984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:26.864147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.864246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:26.864996 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:26.865302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.867583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.876494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:26.877944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:26.883849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 333/675] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:26.883849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:26.899434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:26.900401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:26.901296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:26.901296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:26.901296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:26.901296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 343/676] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:26.901526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:26.923691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:26.990327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359cc39-2124-42e9-926e-c694775a39bc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.007130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:27.014404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed52202-e720-4313-89d9-50bc9fe8e9aa None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.026436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.027067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.029813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.029813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.034391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.035837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:27.049004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:27.049937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 334/677] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:27.050859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.052243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.052845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.053125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.053395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.055326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=bf531e7741af49f091e1116ec1c6751c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:27.055666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.057092 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.064749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 344/678] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:26 2022] GET /identity/v3/role_assignments?user.id=bf531e7741af49f091e1116ec1c6751c&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:27.065620 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.205398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2bf0c-114e-4453-9da1-ae2ffec3d722 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.250716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.251760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.252084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.252364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.253041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:27.253353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.254886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.269471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 345/679] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:27.269844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.294249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:27.300200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:27.306786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809d73-9a43-4317-8dbb-550331871b5e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.347952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dee8cd-76d4-4354-a8fd-67af54485009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.348666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee8cd-76d4-4354-a8fd-67af54485009 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.348942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee8cd-76d4-4354-a8fd-67af54485009 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.349207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dee8cd-76d4-4354-a8fd-67af54485009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.350037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dee8cd-76d4-4354-a8fd-67af54485009 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=5550726a2c5e4aff9c16f509a3d1bb0a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:27.350344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dee8cd-76d4-4354-a8fd-67af54485009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.352504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dee8cd-76d4-4354-a8fd-67af54485009 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.358290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 335/680] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/role_assignments?user.id=5550726a2c5e4aff9c16f509a3d1bb0a&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:27.359657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5a2a6-e23a-4973-9df9-78c44e7d9cdf None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.359940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5a2a6-e23a-4973-9df9-78c44e7d9cdf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.360208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5a2a6-e23a-4973-9df9-78c44e7d9cdf None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.361627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 336/681] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:27.362267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5a2a6-e23a-4973-9df9-78c44e7d9cdf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.398562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a9c5-9daa-43b1-a9a0-45c05b93587f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.443914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305652a2-b5d9-4620-9904-4b391a688a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.445279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305652a2-b5d9-4620-9904-4b391a688a75 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.445786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305652a2-b5d9-4620-9904-4b391a688a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.446846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305652a2-b5d9-4620-9904-4b391a688a75 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.448075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305652a2-b5d9-4620-9904-4b391a688a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:27.448676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305652a2-b5d9-4620-9904-4b391a688a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.450430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305652a2-b5d9-4620-9904-4b391a688a75 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.468677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 346/682] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:27.468677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57895d-199e-4c6a-ba4b-9289d1a3b1e0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.468677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57895d-199e-4c6a-ba4b-9289d1a3b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.468677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57895d-199e-4c6a-ba4b-9289d1a3b1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.489997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0e57895d-199e-4c6a-ba4b-9289d1a3b1e0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:27.491809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0e57895d-199e-4c6a-ba4b-9289d1a3b1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:27.501193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5a2a6-e23a-4973-9df9-78c44e7d9cdf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.542817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.543464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.543745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.544019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.553412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.555477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:27.568408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:27.569557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 337/683] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:27.570773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.583396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 347/684] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:27.584625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57895d-199e-4c6a-ba4b-9289d1a3b1e0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.598203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:27.604093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:27.702551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb1d0-b41d-486c-bec1-4c8eeb225aa8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.717712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57895d-199e-4c6a-ba4b-9289d1a3b1e0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.749057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.750075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.750520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.750993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.751873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=8869c7baa4124705bcb3a8c835f566a6) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:27.752323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.754059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.764867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 338/685] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/role_assignments?user.id=8869c7baa4124705bcb3a8c835f566a6&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:27.771860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.773369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.773746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.774171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:27.775050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:27.775465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:27.777055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:27.798261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 348/686] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:27.804084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.889599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:27.915041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:27.941521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553f622-07b6-46e6-a46d-3c62275c2754 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:27.982593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:27.983132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:27.983414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:27.983688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:28.002253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:28.043254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9545d-c792-4610-8da4-543d0703fdf6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:28.060760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:28.062360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:28.087632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:28.088287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:28.088579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:28.088857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:28.104678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:28.106307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:28.123510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:28.124515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:28.125389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:28.125389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:28.125389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:28.125389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 349/687] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:28.131003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:28.174469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:28.196088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 339/688] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:28.203148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:28.268306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f1392-50f6-48aa-9b15-649ecb0a4468 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:28.301464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:28.337031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:28.337966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:28.338549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:28.339026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:28.339837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:28.340312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:28.341861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:28.359929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 350/689] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:28.365396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:28.392408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47a1c8-9a40-4849-b29a-acf74d17e41f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:28.462723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:28.463666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:28.464929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:28.465409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:28.484184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:28.488104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:28.512542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:28.514818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:28.515742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:28.515742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:28.515742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:28.521716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 340/690] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:28.525654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:28.563738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14ab8-aa7b-4b9c-873a-2dda0095fa7d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:28.577042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:28.630635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:28.631528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:28.633170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:28.633590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:28.635072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:28.636811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:28.685725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c62df-6777-47c4-8476-bb70ace4e4bf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:28.742716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 351/691] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:51:28 2022] POST /identity/v3/users => generated 254 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 15:51:28.744669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:28.745470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:28.745944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:28.746522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:28.747319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:28.747768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:28.749409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:28.764097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 341/692] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:28.769385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:28.823861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:28.903705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d911fb-0d28-4192-b6ce-a875769def9e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:28.940710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:28.941349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:28.941687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:28.942005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:28.950282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:28.951827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:28.964508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:28.965410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:28.966403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 352/693] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:28.971272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:29.082198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:29.089549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4bd3-d286-4afb-8755-2429a863b018 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:29.132177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df02de8-8601-4b5d-ad19-f2c21102b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:29.132825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df02de8-8601-4b5d-ad19-f2c21102b845 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:29.133099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df02de8-8601-4b5d-ad19-f2c21102b845 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:29.133368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df02de8-8601-4b5d-ad19-f2c21102b845 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:29.134093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df02de8-8601-4b5d-ad19-f2c21102b845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:29.134395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df02de8-8601-4b5d-ad19-f2c21102b845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:29.135856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df02de8-8601-4b5d-ad19-f2c21102b845 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:29.152985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 342/694] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:29.158541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:29.266612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:29.274261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4577d30-a33a-4435-82d0-b7f3477cdf24 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:29.315060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a9665-5101-45ba-ba57-3535998347e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:29.316032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9665-5101-45ba-ba57-3535998347e9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:29.316508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9665-5101-45ba-ba57-3535998347e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:29.316976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a9665-5101-45ba-ba57-3535998347e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:29.318927 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a9665-5101-45ba-ba57-3535998347e9 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a21de1ac06b8422fa33aae8a1ad4bcf2) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:29.319985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a9665-5101-45ba-ba57-3535998347e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:29.321777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a9665-5101-45ba-ba57-3535998347e9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:29.328429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 353/695] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:29 2022] GET /identity/v3/role_assignments?user.id=a21de1ac06b8422fa33aae8a1ad4bcf2&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:29.553142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51f055-a70b-4f51-9c48-95cdc10071aa None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:29.554951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51f055-a70b-4f51-9c48-95cdc10071aa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:29.555439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51f055-a70b-4f51-9c48-95cdc10071aa None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:29.557469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 343/696] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:29.563139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad49b51-89c5-4326-bff2-08150e9ffd60 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:29.563732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad49b51-89c5-4326-bff2-08150e9ffd60 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:29.564203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad49b51-89c5-4326-bff2-08150e9ffd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:29.589494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7ad49b51-89c5-4326-bff2-08150e9ffd60 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:29.591129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7ad49b51-89c5-4326-bff2-08150e9ffd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:29.673373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 354/697] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:29.972962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51f055-a70b-4f51-9c48-95cdc10071aa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:30.106594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51f055-a70b-4f51-9c48-95cdc10071aa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:30.154493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:30.155569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.156048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.156515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] PATH_INFO: `/v3/services/network` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.157302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:30.159732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:30.177187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:30.178314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:30.179776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:30.182227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 344/698] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:29 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:30.187450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd809-1eb3-4882-af5b-8c835a4b01f1 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.187903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd809-1eb3-4882-af5b-8c835a4b01f1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.187999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd809-1eb3-4882-af5b-8c835a4b01f1 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.189845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 355/699] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:30.190143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:30.195746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de8f6-270b-4897-8e82-aa56ff9eca11 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.196033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de8f6-270b-4897-8e82-aa56ff9eca11 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.196371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1de8f6-270b-4897-8e82-aa56ff9eca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.225714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ac1de8f6-270b-4897-8e82-aa56ff9eca11 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:30.228417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ac1de8f6-270b-4897-8e82-aa56ff9eca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:30.230332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:30.339743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 356/700] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:30.373725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88948172-6aec-4b41-ba42-924496bd64cc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:30.413993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4a769-837d-47e9-8a64-027dec81bcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:30.414992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4a769-837d-47e9-8a64-027dec81bcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.415469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4a769-837d-47e9-8a64-027dec81bcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.415934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4a769-837d-47e9-8a64-027dec81bcf4 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.416833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4a769-837d-47e9-8a64-027dec81bcf4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:30.417328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4a769-837d-47e9-8a64-027dec81bcf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:30.419085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4a769-837d-47e9-8a64-027dec81bcf4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:30.424169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 345/701] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:51:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:30.430741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de8f6-270b-4897-8e82-aa56ff9eca11 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:30.450715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:30.550483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1de8f6-270b-4897-8e82-aa56ff9eca11 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:30.603421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e9fcb-b139-4eb1-a89b-99dfc13c620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:30.604037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e9fcb-b139-4eb1-a89b-99dfc13c620b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.604318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e9fcb-b139-4eb1-a89b-99dfc13c620b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.604599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e9fcb-b139-4eb1-a89b-99dfc13c620b None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.605234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e9fcb-b139-4eb1-a89b-99dfc13c620b None admin] RBAC: Adding query filter params (type=network) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:30.605538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e9fcb-b139-4eb1-a89b-99dfc13c620b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:30.606944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e9fcb-b139-4eb1-a89b-99dfc13c620b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:30.615468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 357/702] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:51:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:30.673641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf78523-c75a-4979-b1f7-91d7b6cd2b6c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.674625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf78523-c75a-4979-b1f7-91d7b6cd2b6c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.675098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf78523-c75a-4979-b1f7-91d7b6cd2b6c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.676879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 346/703] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:30.682267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47409cfa-ef8b-4c01-a27a-db68fdb5cc5e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.682558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47409cfa-ef8b-4c01-a27a-db68fdb5cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.682818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47409cfa-ef8b-4c01-a27a-db68fdb5cc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.711497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-47409cfa-ef8b-4c01-a27a-db68fdb5cc5e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:30.712720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-47409cfa-ef8b-4c01-a27a-db68fdb5cc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:30.738793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf78523-c75a-4979-b1f7-91d7b6cd2b6c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:30.821294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 358/704] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:30.854099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:30.874280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf78523-c75a-4979-b1f7-91d7b6cd2b6c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:30.916481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:30.917227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:30.917393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:30.917652 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:30.928281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:30.933813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:30.934741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:30.935568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 347/705] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:30.940840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47409cfa-ef8b-4c01-a27a-db68fdb5cc5e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:30.957098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:31.167151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47409cfa-ef8b-4c01-a27a-db68fdb5cc5e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:31.224950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:31.226296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:31.226745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:31.227157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:31.227967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:31.228407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:31.229919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:31.238830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 359/706] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:31.245394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:31.255160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:31.393510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:31.405826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef489269-8902-4c71-99a4-ffcfffcf9eec None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:31.451680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5e8b6-2e3f-480e-b16f-da82bb9d6557 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:31.469703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:31.470611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:31.471090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:31.471502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:31.495696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:31.497559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:31.503630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:31.523285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:31.529219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:31.530136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:31.530136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:31.530136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:31.530136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 348/707] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:31.530378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:31.530378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:31.530378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:31.530575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:31.531087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:31.537816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:31.539268 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:31.562117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:31.563204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:31.564040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 360/708] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Oct 3 15:51:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:31.570315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:31.708221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4434ab0-6f9e-4c48-8fa1-02a4914e62b9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:31.735317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c522292-0b5c-45a3-8b22-b6b4a7e9245a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:31.792454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:31.793084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:31.793366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:31.793642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:31.794327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:31.794633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:31.796051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:31.826992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 349/709] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:31.827650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:31.828281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:31.828564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:31.828838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:31.829474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:31.829786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:31.831131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:31.831243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:31.841653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 361/710] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Oct 3 15:51:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:31.844130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:31.846842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:31.954522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:31.969189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d90d67-7cab-469b-8100-ffb06b975d45 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:32.003973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f888a-b6e5-49d6-9d95-4cc06d11b04d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:32.015690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acd28c-496e-4aa7-9163-8299eabda408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:32.016718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd28c-496e-4aa7-9163-8299eabda408 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.017009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd28c-496e-4aa7-9163-8299eabda408 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.017293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acd28c-496e-4aa7-9163-8299eabda408 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.018238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd28c-496e-4aa7-9163-8299eabda408 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:32.018552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd28c-496e-4aa7-9163-8299eabda408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:32.020649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acd28c-496e-4aa7-9163-8299eabda408 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:32.034030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 362/711] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Oct 3 15:51:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:32.035865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9083e-fb88-4d1d-a30c-2f1d1c9657cd None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.036147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9083e-fb88-4d1d-a30c-2f1d1c9657cd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.038561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9083e-fb88-4d1d-a30c-2f1d1c9657cd None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.046662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 363/712] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:32.048496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108120-1b74-48e7-bfa2-ea7e1463dadf None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.050841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108120-1b74-48e7-bfa2-ea7e1463dadf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.051112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108120-1b74-48e7-bfa2-ea7e1463dadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.073036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:32.073696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.074010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.074398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.086814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f5108120-1b74-48e7-bfa2-ea7e1463dadf None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:32.088574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f5108120-1b74-48e7-bfa2-ea7e1463dadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:32.091839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:32.093337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:32.117225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:32.118254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:32.119201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 350/713] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:51:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:32.124318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:32.230454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:32.243141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 364/714] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:32.292087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb00b6-1abe-4fca-8628-177c00e34d51 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:32.316427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:32.337380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c81bf-5b00-43ce-8529-0c2589a850e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:32.338089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c81bf-5b00-43ce-8529-0c2589a850e2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.338379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c81bf-5b00-43ce-8529-0c2589a850e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.338660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c81bf-5b00-43ce-8529-0c2589a850e2 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.339459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c81bf-5b00-43ce-8529-0c2589a850e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:32.339776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c81bf-5b00-43ce-8529-0c2589a850e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:32.341273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c81bf-5b00-43ce-8529-0c2589a850e2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:32.360504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 351/715] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:51:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:32.366162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5108120-1b74-48e7-bfa2-ea7e1463dadf None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:32.432119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5fd2c-450e-42c6-a954-31ea5c211af9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.432757 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5fd2c-450e-42c6-a954-31ea5c211af9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.433255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5fd2c-450e-42c6-a954-31ea5c211af9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.434992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 352/716] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:51:32.440442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4fcd-d8c4-47b9-abbe-29b6dfc42132 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.440797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4fcd-d8c4-47b9-abbe-29b6dfc42132 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.441158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4fcd-d8c4-47b9-abbe-29b6dfc42132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.474535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-63cc4fcd-d8c4-47b9-abbe-29b6dfc42132 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:32.476960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-63cc4fcd-d8c4-47b9-abbe-29b6dfc42132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:32.497022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5108120-1b74-48e7-bfa2-ea7e1463dadf None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:32.560587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:32.561885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.562373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.563131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.591349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 353/717] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 15:51:32.592478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc4fcd-d8c4-47b9-abbe-29b6dfc42132 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:32.672034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:32.681252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:32.682748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:32.762030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc4fcd-d8c4-47b9-abbe-29b6dfc42132 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:32.766063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:32.824465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:32.825112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:32.825398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:32.825675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:32.849462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:32.856709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:32.857680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:32.858576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:32.862815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 354/718] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:32.868123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:32.878325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 365/719] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:32.883902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.001265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.007969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533a0f7-3d5b-404b-b326-3aed184f322b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.008847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e15307-cff7-4d1a-b585-886167e57c55 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.046645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.047746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.048311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.048715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.048981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.049577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.049991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.050196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:33.050431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.050817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.052477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.063525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 355/720] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:33.063763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.064863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.072005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:33.091863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:33.092960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:33.094522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:33.094522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:33.094522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:33.094522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 366/721] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:33.094522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.102624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.198721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f88a8-bad3-44a1-ac5b-95dc7077875b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.223741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e84d5-4c27-4ead-bc70-efc7a60eef4b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.234342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.234921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.235204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.235477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.247753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:33.252959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:33.253900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:33.254774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 356/722] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:33.255496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.266379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c70392-b3e4-4240-9e51-c7c45a477cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.267379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c70392-b3e4-4240-9e51-c7c45a477cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.267664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c70392-b3e4-4240-9e51-c7c45a477cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.267941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c70392-b3e4-4240-9e51-c7c45a477cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.279846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c70392-b3e4-4240-9e51-c7c45a477cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.281339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c70392-b3e4-4240-9e51-c7c45a477cc4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.290214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b6c70392-b3e4-4240-9e51-c7c45a477cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:33.296954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:33.298071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:33.298967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:33.298967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:33.298967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:33.298967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 367/723] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:33.298967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e173a-ea61-4729-904f-5b5bd3682cb6 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.299248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e173a-ea61-4729-904f-5b5bd3682cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.299679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e173a-ea61-4729-904f-5b5bd3682cb6 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.300758 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 368/724] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:33.301350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e173a-ea61-4729-904f-5b5bd3682cb6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.357538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.372200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9b6ff-2687-42c5-83e7-ae3ebaae0ed0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.409542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.410276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.410567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.410845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.411486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:33.411793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.413334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.430235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 357/725] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:33.430235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.431401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e173a-ea61-4729-904f-5b5bd3682cb6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.472183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d24a-ba32-4175-b83b-36275d3f8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.472889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d24a-ba32-4175-b83b-36275d3f8c4a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.473170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d24a-ba32-4175-b83b-36275d3f8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.473442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d24a-ba32-4175-b83b-36275d3f8c4a None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.474136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d24a-ba32-4175-b83b-36275d3f8c4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:33.474461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d24a-ba32-4175-b83b-36275d3f8c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.476503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882d24a-ba32-4175-b83b-36275d3f8c4a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.489691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 369/726] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:33.489691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e0875-a3f9-44d7-9592-d36345e6b2c3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.489691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e0875-a3f9-44d7-9592-d36345e6b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.489691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e0875-a3f9-44d7-9592-d36345e6b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.508709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8f4e0875-a3f9-44d7-9592-d36345e6b2c3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:33.509918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8f4e0875-a3f9-44d7-9592-d36345e6b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:33.538174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb325a-56d1-4758-809a-63cafbe6b615 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.572844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.576755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.577369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.577651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.577954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.578594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:33.579068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.580267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.585909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 370/727] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:33.586906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e0875-a3f9-44d7-9592-d36345e6b2c3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.603669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 358/728] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:33.603669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.610754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.708842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e0875-a3f9-44d7-9592-d36345e6b2c3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.710384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651dee9c-40ab-4ca2-aaa8-cd89e8897a32 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.747224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.748127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.748644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.749062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.749176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.749977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.750385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.750758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.757752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.759485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.762984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.764526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:33.772421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:33.773562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:33.774496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:33.776612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 371/729] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:33.777536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:33.780523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:33.781455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:33.782404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:33.782404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:33.782404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:33.783213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 359/730] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:33.784371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.837567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.848667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:33.891011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f3699-f8fe-407a-a920-6010d4c85fac None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.895523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a54fde-0771-459e-ae5e-0d191173f5f4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:33.928103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.929329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.929612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.929921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.932392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:33.933005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:33.933294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:33.933570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:33.934286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:33.934597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.936035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.937847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:33.939283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:33.953813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 360/731] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:33.953813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:33.954047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:33.954937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 372/732] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:33.955860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.057329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4f7c3-202e-4dc2-80df-e65bf553b33e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.064327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e49aa2-2d46-489b-8ce1-c33a8194fceb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.073081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:34.084587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:34.096665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:34.097224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.097488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.097772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.098450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:34.099848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:34.102412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:34.103030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.103312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.103596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.104237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:34.104546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:34.106320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:34.117912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 361/733] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:34.118715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.184252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 373/734] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:51:33 2022] POST /identity/v3/services => generated 240 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:34.185071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.237668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f058d-34e2-4b53-ab34-20cfe118eefc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.290792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:34.291430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.291711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.291987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.292734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=5550726a2c5e4aff9c16f509a3d1bb0a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:34.293047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:34.294547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:34.307109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 362/735] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:34 2022] GET /identity/v3/role_assignments?user.id=5550726a2c5e4aff9c16f509a3d1bb0a&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:34.307109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.363001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b940-4cea-426d-ac5a-449bffd22459 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.381003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:34.419050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:34.419709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.419993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.420270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.421021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:34.421413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:34.422884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:34.445061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 374/736] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Oct 3 15:51:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:34.450849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.485713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7684-3937-4469-9f46-1acfef4e741f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.496045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:34.532856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2073-e7ac-488e-8c13-6507a4cb2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:34.533525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2073-e7ac-488e-8c13-6507a4cb2a76 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.533820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2073-e7ac-488e-8c13-6507a4cb2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.534104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2073-e7ac-488e-8c13-6507a4cb2a76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.543307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2073-e7ac-488e-8c13-6507a4cb2a76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:34.544784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2073-e7ac-488e-8c13-6507a4cb2a76 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4e4e2073-e7ac-488e-8c13-6507a4cb2a76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:34.560487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:34.561680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:34.562872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 363/737] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:34.563596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ffe74-3427-4fab-a9ee-01958b9c5375 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.563596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ffe74-3427-4fab-a9ee-01958b9c5375 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.563743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ffe74-3427-4fab-a9ee-01958b9c5375 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.565875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 364/738] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:34.570809 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ffe74-3427-4fab-a9ee-01958b9c5375 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.590406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66dbe-4073-4777-b2ee-d8b7420be203 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.627728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:34.628483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.628876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.629244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.703657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:34.705379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:34.722128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:34.727069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ffe74-3427-4fab-a9ee-01958b9c5375 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.747134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:34.782325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ede0c3-14a7-4a8d-b401-7f32abebf478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:34.782992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ede0c3-14a7-4a8d-b401-7f32abebf478 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.783228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ede0c3-14a7-4a8d-b401-7f32abebf478 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.783514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ede0c3-14a7-4a8d-b401-7f32abebf478 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.784519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ede0c3-14a7-4a8d-b401-7f32abebf478 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:34.784833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ede0c3-14a7-4a8d-b401-7f32abebf478 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:34.786322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ede0c3-14a7-4a8d-b401-7f32abebf478 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:34.810327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 365/739] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Oct 3 15:51:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:34.812081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f733f1-eaf4-4e25-970a-9f491533c49e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:34.812548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f733f1-eaf4-4e25-970a-9f491533c49e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:34.813108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f733f1-eaf4-4e25-970a-9f491533c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:34.832243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-28f733f1-eaf4-4e25-970a-9f491533c49e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:34.834070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-28f733f1-eaf4-4e25-970a-9f491533c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:34.834613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 375/740] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:34 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:34.835816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.934289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 366/741] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:34 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 15:51:34.935067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f733f1-eaf4-4e25-970a-9f491533c49e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:34.963157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b3bb7-34fb-4a16-b254-95881c5497b1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:34.996056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:35.002969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.004056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.004529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.004963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.081365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:35.083635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:35.172321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:35.188012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f733f1-eaf4-4e25-970a-9f491533c49e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:35.197037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 376/742] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:34 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 15:51:35.202814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:35.230975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.231998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.232503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.232981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.245084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:35.246956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:35.263798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:35.264865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:35.265846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:35.265846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:35.265846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:35.268452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 367/743] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:35.275708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:35.278745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:35.386161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861372c-cbd0-4e1f-93d5-93e2e312c551 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:35.419739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b64ba-548e-4f2c-9463-22558e07e817 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:35.424444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.425271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.425702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.426142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.438095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:35.439850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:35.457135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:35.458574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:35.459834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:35.459834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:35.459834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:35.461486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 377/744] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:35.462281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.462693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:35.463081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.463454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.463875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.464562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:35.464963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:35.466800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:35.475791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:35.485792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 368/745] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:35.485792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:35.559468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:35.578387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261652b-d1fa-4514-8043-e8c97e59f875 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:35.616567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65c217-5a84-42b4-a104-e6af6638d558 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:35.624218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.625587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.626080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.627089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.627834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:35.629583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:35.654600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.655320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.655698 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.656030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.656769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:35.657145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:35.658632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:35.676019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 369/746] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:35.676019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:35.698083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 378/747] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:51:35 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:35.699029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:35.775627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:35.851084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad05b7f-e7d9-471b-ac0c-95d3b8b9aa7b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:35.924005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.925051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.925527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.927244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.933320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6e03b-c877-4632-9868-60ac80ee8594 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:35.935251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:35.936970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:35.950367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:35.951274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:35.952161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:35.954546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 370/748] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:35.963263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:35.987529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:35.988477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:35.988768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:35.989046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:35.999478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:36.000834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:36.002992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:36.017602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:36.019002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:36.025498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 379/749] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:36.027537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:36.097351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479604b-1209-4b5d-bc54-1ba09944b117 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:36.114372 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:36.136741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:36.137795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.138274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.138740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.139645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:36.140169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:36.142579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:36.148735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d0d25-aaac-4474-b357-0122e49f8e44 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:36.158132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 371/750] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:36.166812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:36.197431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:36.199486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.202777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.204190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.205145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:36.207197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:36.211146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:36.236036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 380/751] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:36.237594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:36.313788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:36.323305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a0870-0ab3-4291-848d-9e0e5d8b33d3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:36.381618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a10566-92b0-42ef-8410-cfc2011f6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:36.382250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10566-92b0-42ef-8410-cfc2011f6aca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.382526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10566-92b0-42ef-8410-cfc2011f6aca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.382795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10566-92b0-42ef-8410-cfc2011f6aca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.386690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a10566-92b0-42ef-8410-cfc2011f6aca None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a977434e408a4fac94b0757de67c97cc) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:36.387086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a10566-92b0-42ef-8410-cfc2011f6aca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:36.388524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a10566-92b0-42ef-8410-cfc2011f6aca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:36.392823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93aa29-fbe1-47d3-b135-da0869535f2b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:36.404845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 372/752] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:36 2022] GET /identity/v3/role_assignments?user.id=a977434e408a4fac94b0757de67c97cc&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:36.437629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480c3b4-8603-40a0-84a8-957de256b5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:36.439788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480c3b4-8603-40a0-84a8-957de256b5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.440146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480c3b4-8603-40a0-84a8-957de256b5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.440425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480c3b4-8603-40a0-84a8-957de256b5d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.441196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480c3b4-8603-40a0-84a8-957de256b5d0 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a21de1ac06b8422fa33aae8a1ad4bcf2) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:36.441510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480c3b4-8603-40a0-84a8-957de256b5d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:36.443063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480c3b4-8603-40a0-84a8-957de256b5d0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:36.450022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 381/753] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:36 2022] GET /identity/v3/role_assignments?user.id=a21de1ac06b8422fa33aae8a1ad4bcf2&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:36.698697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327108a-04dc-4707-a5af-2a7aeb174865 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.699109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327108a-04dc-4707-a5af-2a7aeb174865 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.699290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327108a-04dc-4707-a5af-2a7aeb174865 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.700923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 373/754] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:36.706728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521007f2-bccd-42b4-bee8-b58cf967fd28 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.707022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521007f2-bccd-42b4-bee8-b58cf967fd28 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.707304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521007f2-bccd-42b4-bee8-b58cf967fd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.736782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-521007f2-bccd-42b4-bee8-b58cf967fd28 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:36.738047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-521007f2-bccd-42b4-bee8-b58cf967fd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:36.784756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fb387-b3ea-4dfb-8eab-c3fac6c1aa98 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.785467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fb387-b3ea-4dfb-8eab-c3fac6c1aa98 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.786047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fb387-b3ea-4dfb-8eab-c3fac6c1aa98 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.793117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 374/755] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:36.799335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647e43-e8c7-4639-849f-320104054f7b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:36.799656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647e43-e8c7-4639-849f-320104054f7b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:36.799935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9647e43-e8c7-4639-849f-320104054f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:36.827422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 382/756] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:36.835132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f9647e43-e8c7-4639-849f-320104054f7b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:36.836338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f9647e43-e8c7-4639-849f-320104054f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:36.883102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:36.935449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 375/757] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:37.208764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521007f2-bccd-42b4-bee8-b58cf967fd28 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:37.266118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9647e43-e8c7-4639-849f-320104054f7b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:37.281465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:37.364426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521007f2-bccd-42b4-bee8-b58cf967fd28 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:37.391728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9647e43-e8c7-4639-849f-320104054f7b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:37.435447 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:37.436495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:37.436985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:37.437460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:37.438383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:37.439879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:37.448769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:37.448887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:37.448887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:37.448887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:37.451627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:37.452597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:37.453537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:37.456724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 376/758] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:37 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:37.463612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:37.476825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:37.483817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:37.484767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:37.485662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:37.488694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 383/759] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:37.495280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:37.523717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:37.651871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b213-c07e-4fbd-8590-21c0076405a8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:37.685035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965b12b-745b-4544-a695-15b41b0c0e0d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:37.711377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:37.733120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:37.734231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:37.734890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:37.736481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:37.737291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] RBAC: Adding query filter params (name=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:37.738497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:37.740681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:37.755420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 377/760] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:51:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:37.757603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:37.763752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:37.764583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:37.765896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:37.766415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:37.768910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:37.769406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:37.773896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:37.789306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 384/761] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:37.794469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:37.950136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:37.959780 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e0bf3-97ed-4713-bd59-18ae5bdb7b84 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:37.961748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274104f-6153-4121-bda2-3ed46d7ae837 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:38.019130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.019669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.019945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.020212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.020843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] RBAC: Adding query filter params (type=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:38.021144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.022591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:38.031250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.031889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.032165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.032435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.043585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 378/762] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:51:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:38.048083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.049957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:38.058291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:38.085605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:38.086641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:38.087555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:38.087555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:38.087555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:38.087555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 385/763] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:38.089542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:38.142861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:38.232091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205ad6-2589-4aca-9c02-05102ca139ae None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:38.275417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88188a6e-dd95-4671-b8b7-1357eae0bbab None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:38.288381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.289018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.289299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.289571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.290319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] RBAC: Adding query filter params (interface=public, service_id=15cf1c00c7fd4fe4bb02e8bc1d993cab, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:38.290633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.292053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:38.307196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 379/764] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:51:38 2022] GET /identity/v3/endpoints?service_id=15cf1c00c7fd4fe4bb02e8bc1d993cab&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:38.311995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:38.349090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.349697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.350006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.350857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.351526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:38.351799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.353167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:38.360207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:38.375412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 386/765] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:38.381063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:38.471023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2e83-f82f-4ef6-ac97-bfc18d3e46c1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:38.495559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:38.507523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d9a50-34e3-4b60-8158-7d3085143d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.508192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9a50-34e3-4b60-8158-7d3085143d58 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.508472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9a50-34e3-4b60-8158-7d3085143d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.508745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9a50-34e3-4b60-8158-7d3085143d58 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.509343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d9a50-34e3-4b60-8158-7d3085143d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.510739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d9a50-34e3-4b60-8158-7d3085143d58 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:38.511671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5eef8-1681-4809-9849-41522365fc9f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:38.516501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 380/766] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:51:38 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:38.517976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb447-2fbe-41d7-9a09-e2cc47df925c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.518182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb447-2fbe-41d7-9a09-e2cc47df925c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.518504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb447-2fbe-41d7-9a09-e2cc47df925c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.524731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 381/767] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:38.526763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2d5b1-c478-4baf-94d1-bea017e5620f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.526981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2d5b1-c478-4baf-94d1-bea017e5620f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.527321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2d5b1-c478-4baf-94d1-bea017e5620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.558632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.559296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.559579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.559853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.575412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.577020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:38.583233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f4e2d5b1-c478-4baf-94d1-bea017e5620f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:38.584472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f4e2d5b1-c478-4baf-94d1-bea017e5620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:38.591320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:38.593529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:38.595932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 387/768] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:51:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:38.598438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:38.739872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 382/769] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:38.767570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72fb78-ec91-45f0-b21f-ba1e22df72a0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:38.804574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.805412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.805874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.806318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.807191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:38.807650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.809224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:38.828721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 388/770] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:51:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:38.834449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2d5b1-c478-4baf-94d1-bea017e5620f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:38.857144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:38.943821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2d5b1-c478-4baf-94d1-bea017e5620f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:38.984170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243246af-5a70-4164-9af8-98c02185f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:38.985486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243246af-5a70-4164-9af8-98c02185f4fa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:38.985948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243246af-5a70-4164-9af8-98c02185f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:38.986399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243246af-5a70-4164-9af8-98c02185f4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:38.997245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243246af-5a70-4164-9af8-98c02185f4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:38.998971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243246af-5a70-4164-9af8-98c02185f4fa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-243246af-5a70-4164-9af8-98c02185f4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:39.014452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:39.015651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:39.016812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:39.016812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:39.016812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:39.018540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 383/771] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:39.026893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.042147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:39.067544 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cbb54-4d7d-4080-a57e-e94f740776a7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.067847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cbb54-4d7d-4080-a57e-e94f740776a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.068047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cbb54-4d7d-4080-a57e-e94f740776a7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.069725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 384/772] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:39.075756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb9f9-a342-49a0-b0d6-253a77d2a350 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.076080 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb9f9-a342-49a0-b0d6-253a77d2a350 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.076393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fb9f9-a342-49a0-b0d6-253a77d2a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.097613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ca9fb9f9-a342-49a0-b0d6-253a77d2a350 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:39.098858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ca9fb9f9-a342-49a0-b0d6-253a77d2a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:39.199672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:39.205319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 385/773] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:39.206175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fb9f9-a342-49a0-b0d6-253a77d2a350 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.212467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed56a8-75ea-45c1-85d1-a2333381f0e0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:39.250279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dc49d-f915-47a3-b6f5-7a5cc62eec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:39.251297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dc49d-f915-47a3-b6f5-7a5cc62eec93 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.251773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dc49d-f915-47a3-b6f5-7a5cc62eec93 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.252295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dc49d-f915-47a3-b6f5-7a5cc62eec93 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.253237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dc49d-f915-47a3-b6f5-7a5cc62eec93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:39.253742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dc49d-f915-47a3-b6f5-7a5cc62eec93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:39.255505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dc49d-f915-47a3-b6f5-7a5cc62eec93 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:39.271610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 389/774] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:39.273286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e69238-7502-44f0-b59a-4e3f7920a6fc None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.273812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e69238-7502-44f0-b59a-4e3f7920a6fc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.274284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e69238-7502-44f0-b59a-4e3f7920a6fc None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.276076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 390/775] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:39.285461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e69238-7502-44f0-b59a-4e3f7920a6fc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.344633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fb9f9-a342-49a0-b0d6-253a77d2a350 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:39.354116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:39.383807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09be9-92b7-45a0-b80a-50d70c67bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:39.384686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09be9-92b7-45a0-b80a-50d70c67bab6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.385509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09be9-92b7-45a0-b80a-50d70c67bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.385968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09be9-92b7-45a0-b80a-50d70c67bab6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.386704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09be9-92b7-45a0-b80a-50d70c67bab6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:39.388761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09be9-92b7-45a0-b80a-50d70c67bab6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:39.399311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e69238-7502-44f0-b59a-4e3f7920a6fc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f3d09be9-92b7-45a0-b80a-50d70c67bab6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:39.403087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:39.405067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:39.405967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:39.408891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 386/776] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:39.410367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2988-4b5f-44d3-9970-60614f50127a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.410855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2988-4b5f-44d3-9970-60614f50127a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.411279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c2988-4b5f-44d3-9970-60614f50127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.436131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f75c2988-4b5f-44d3-9970-60614f50127a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:39.438034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f75c2988-4b5f-44d3-9970-60614f50127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:39.444323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:39.444959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.445243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.445518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.461043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:39.463541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:39.479126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:39.480203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:39.481299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:39.488157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 391/777] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:39.488157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.516057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:39.525143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 387/778] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:39.525998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2988-4b5f-44d3-9970-60614f50127a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.624634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389db16-bc3c-4faf-a835-19c9d2a37e1d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:39.627366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c2988-4b5f-44d3-9970-60614f50127a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:39.657657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:39.663599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:39.664326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.664678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.665022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.665834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:39.666224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:39.667872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:39.673719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:39.674683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.675136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.676231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.677034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:39.677347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:39.680244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:39.683651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 388/779] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:39.684888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.690761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 392/780] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:39.691842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.762338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:39.815105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f4116-ed4a-4644-a2db-61948febd2ca None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:39.828329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4132-58e0-4a45-81d6-a4a75d85265f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:39.849694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:39.850406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.850688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.850965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.861206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:39.866483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:39.867079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:39.868204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 389/781] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:39.869045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.870071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:39.870359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:39.870631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/5550726a2c5e4aff9c16f509a3d1bb0a/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:39.873048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=5550726a2c5e4aff9c16f509a3d1bb0a, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:39.874448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:39.969645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 393/782] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:39 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/5550726a2c5e4aff9c16f509a3d1bb0a/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:51:39.970788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:39.981752 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00ee9b-1218-469f-96c6-cfdfdfd1064f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.000224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:40.030183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.031802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.032225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.032851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.033657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:40.034066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.036554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.042456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:40.046935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 390/783] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:40.047976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.110012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b00f3-6afb-41d9-948f-486f59e23a97 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.154037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.155286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.155863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.156392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.174409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:40.180633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:40.181561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:40.182473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 394/784] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:40.183167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.204967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf1581-4591-4a01-a434-f200102b7842 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.250320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.251916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.252378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.252876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.254412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:40.255195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.257526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.269060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 391/785] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:40.270200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.303057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8616f-128d-4a4e-b447-0cfec1e75af3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.312748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:40.326743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:40.340393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.341094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.341449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.341826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.342731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] RBAC: Adding query filter params (interface=public, service_id=ea3b9c64b7724d38b6cfcfa845290d1c, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:40.342906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.344400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.353603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 395/786] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/endpoints?service_id=ea3b9c64b7724d38b6cfcfa845290d1c&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:40.358676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.405550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab344c-d6d9-4793-9398-50dcff9b3113 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.457695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.458898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.459353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.459984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.460909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:40.461431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.463080 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.472751 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 392/787] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:40.473902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.480346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aac7a-f8e9-41d9-a009-74a8d5487f83 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.515918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.516489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.516754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.517031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.528866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.530349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:40.545636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:40.546846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:40.547817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:40.547817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:40.547817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:40.548828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 396/788] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:40.549686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.575763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:40.597545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4e37-9848-4595-b5da-6d5d1b1f4a7d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.600316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:40.649927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.651263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.651699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.652125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.652876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.655284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.663075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 393/789] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:40.664059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.677033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cc1c2-aa5c-4283-8b3d-faa4223cdf7d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.773616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.774283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.774566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.775406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.803479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.805370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.833036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e614f6-dbb3-4c81-8981-0197b7b971bd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:40.839147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:40.840390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:40.841505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:40.841505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:40.841505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:40.851668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 397/790] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:40.859628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.908445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:40.909067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:40.909345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:40.909617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:40.910298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:40.910601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:40.911973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:40.927377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 394/791] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:40.939362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:40.976018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:40.976222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:41.004658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4e3d6-55a3-440c-af46-6eea4dd325ef None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.059525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c56892-8e96-48bc-8fba-cc9ca57dd621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.060064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56892-8e96-48bc-8fba-cc9ca57dd621 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.060336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56892-8e96-48bc-8fba-cc9ca57dd621 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.060611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56892-8e96-48bc-8fba-cc9ca57dd621 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.061254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c56892-8e96-48bc-8fba-cc9ca57dd621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:41.061560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c56892-8e96-48bc-8fba-cc9ca57dd621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.062981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c56892-8e96-48bc-8fba-cc9ca57dd621 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.076129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 398/792] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:41.077176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf23df-7e0d-4d63-877d-84450d0bb5a8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.077613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c586dac-54e2-4b24-a1b0-fc023fe44a57 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.077808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c586dac-54e2-4b24-a1b0-fc023fe44a57 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.078061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c586dac-54e2-4b24-a1b0-fc023fe44a57 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.079527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 399/793] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:41.087123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef704470-6383-4d79-9249-df6ac44cc1de None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.087408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef704470-6383-4d79-9249-df6ac44cc1de None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.087686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef704470-6383-4d79-9249-df6ac44cc1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.106286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ef704470-6383-4d79-9249-df6ac44cc1de None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:41.107487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ef704470-6383-4d79-9249-df6ac44cc1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:41.122152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.123567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.124228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.124645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.134485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.136813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:41.152730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:41.153940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:41.155128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:41.158253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 395/794] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:41.159609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.183745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 400/795] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:41.184606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef704470-6383-4d79-9249-df6ac44cc1de None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.267141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:41.285626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580b107-ba1e-4376-b0df-b016dd065aa8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.324122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.325078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.325556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.326202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.336291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.338077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:41.356729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:41.357709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:41.359116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:41.360229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:41.362908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 396/796] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:41.370912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.432914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef704470-6383-4d79-9249-df6ac44cc1de None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.468196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.468818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.469105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.469385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.470150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:41.470567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.471911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.490151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 401/797] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:41.498681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.574349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c685d-2ca4-45cc-830f-a90e27daf1ee None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.617954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.618858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.619281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.619766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.620682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:41.621179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.622822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.642612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 397/798] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:41.643754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.644178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c18d07-2e6e-432a-bc8c-555146198b72 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.648278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:41.671012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:41.684376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.685647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.686696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.687213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.698675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.700623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:41.719214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:41.720364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:41.721455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:41.721455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:41.721455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:41.728615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 402/799] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:41.729399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.776759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258479d-fbe8-48c9-9574-1d5817b60358 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.811855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.812840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.813316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.813820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] PATH_INFO: `/v3/services/network` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.814619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.816194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:41.825991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:41.826958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 15:51:41.827781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:41.830638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 398/800] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:41.831683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.854882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a320f1-4df8-46f9-a801-0f122be4b315 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.893087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.894188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:41.894728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:41.895280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:41.907657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:41.910146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:41.914015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:41.927496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:41.934318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:41.935422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:41.935422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:41.935422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:41.935422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 403/801] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:41.935422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:41.957262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20471aa8-b78f-4399-8649-cd89d642d6cc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:41.973224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:41.999094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:41.999765 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.000045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.000607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.001054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:42.001430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.002892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.025097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 399/802] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:42.025994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.071550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4ad62-d9ee-421f-ad06-58aba57df292 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.114729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.116267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.116942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.117429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.118284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] RBAC: Adding query filter params (name=network) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:42.118791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.120546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.126892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 404/803] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:51:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:42.127965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.141683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ac86e-1af1-476e-baa7-2348078304aa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.169211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:42.177029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.177720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.178658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.179014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.179784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:42.180176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.181556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.193600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 400/804] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:42.195440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.244853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:42.254986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14df2e-b029-4397-abe5-4b8658a3b412 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.299280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.300553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.300553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.300553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.309388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.311117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:42.325519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:42.326522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:42.327732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 405/805] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:42.328994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.345342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03276f-acec-4175-94a9-84efba1baf3e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.392353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.393436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.394292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.394733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.395743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] RBAC: Adding query filter params (type=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:42.396498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.398889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.406389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 401/806] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:51:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:42.407462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.447989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957caffc-4927-4624-8d67-e78757086e51 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.474494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:42.485592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.486358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.486698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.487035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.495575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.497131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:42.508912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:42.510088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:42.511069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:42.514872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 406/807] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:42.515457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.524098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366bebb-e575-43f5-856f-422d52e1c449 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.531080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:42.562031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7e49c-92be-427f-80e5-1334121adc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.562638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e49c-92be-427f-80e5-1334121adc91 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.562917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e49c-92be-427f-80e5-1334121adc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.563189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7e49c-92be-427f-80e5-1334121adc91 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.563962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7e49c-92be-427f-80e5-1334121adc91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:42.564269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7e49c-92be-427f-80e5-1334121adc91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.565690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7e49c-92be-427f-80e5-1334121adc91 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.583502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 402/808] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:42.583502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a7593-b43d-456a-8ffb-09c7bdef3e9d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.583502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a7593-b43d-456a-8ffb-09c7bdef3e9d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.583502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a7593-b43d-456a-8ffb-09c7bdef3e9d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.583502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 403/809] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:42.583502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a7593-b43d-456a-8ffb-09c7bdef3e9d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.633701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0d570-59fd-4954-8891-cebb81124c18 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.677959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad5828-730c-4d7d-bb95-bd01fd34f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.678520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5828-730c-4d7d-bb95-bd01fd34f6f4 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.678807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5828-730c-4d7d-bb95-bd01fd34f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.679084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5828-730c-4d7d-bb95-bd01fd34f6f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.679751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad5828-730c-4d7d-bb95-bd01fd34f6f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.681115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad5828-730c-4d7d-bb95-bd01fd34f6f4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.699212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a7593-b43d-456a-8ffb-09c7bdef3e9d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.713492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:42.735493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.736107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.736384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.736654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.737338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:42.737644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.739108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.750642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 404/810] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:42.751433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:42.806307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 407/811] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:51:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:42.807790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf38e-465d-4814-a7b9-2954742e62eb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.808082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf38e-465d-4814-a7b9-2954742e62eb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.808360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf38e-465d-4814-a7b9-2954742e62eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.854925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-beddf38e-465d-4814-a7b9-2954742e62eb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:42.856141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-beddf38e-465d-4814-a7b9-2954742e62eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:42.856529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344d557-9d1c-4595-a4df-d4120dc8ae4c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:42.927701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d15e9-5690-46d5-a36f-c195d80eb9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:42.929490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d15e9-5690-46d5-a36f-c195d80eb9c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:42.929880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d15e9-5690-46d5-a36f-c195d80eb9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:42.930821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d15e9-5690-46d5-a36f-c195d80eb9c3 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a21de1ac06b8422fa33aae8a1ad4bcf2/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:42.933695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d15e9-5690-46d5-a36f-c195d80eb9c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=a21de1ac06b8422fa33aae8a1ad4bcf2, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:42.935779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d15e9-5690-46d5-a36f-c195d80eb9c3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:42.947915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:42.954475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 408/812] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:42.955469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddf38e-465d-4814-a7b9-2954742e62eb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:43.041121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 405/813] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:42 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a21de1ac06b8422fa33aae8a1ad4bcf2/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:51:43.085500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddf38e-465d-4814-a7b9-2954742e62eb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:43.110498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b62ed-ec57-4327-9e7e-f63c4e9d0ac2 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:43.111130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b62ed-ec57-4327-9e7e-f63c4e9d0ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:43.111607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b62ed-ec57-4327-9e7e-f63c4e9d0ac2 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:43.113549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 406/814] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:51:43.120155 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818fbd-2b5e-46be-9b8e-d837bd4515fa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:43.120803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818fbd-2b5e-46be-9b8e-d837bd4515fa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:43.121278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818fbd-2b5e-46be-9b8e-d837bd4515fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:43.128316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:43.129004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:43.129288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:43.129575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a977434e408a4fac94b0757de67c97cc/roles/1ff414d138e94c31ac02e205bfabb944` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:43.145410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ee818fbd-2b5e-46be-9b8e-d837bd4515fa None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:43.148346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ee818fbd-2b5e-46be-9b8e-d837bd4515fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:43.148497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=a977434e408a4fac94b0757de67c97cc, role_id=1ff414d138e94c31ac02e205bfabb944)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:43.149954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:43.182030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:43.228485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 409/815] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:42 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a977434e408a4fac94b0757de67c97cc/roles/1ff414d138e94c31ac02e205bfabb944 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:51:43.236764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:43.260110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 407/816] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:43.298936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:43.363226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7384e-a41a-4168-a90d-9bcb89a5e168 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:43.405276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:43.405960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:43.406245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:43.406523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:43.419460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:43.424853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:43.425857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:43.426713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 410/817] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:43.432761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818fbd-2b5e-46be-9b8e-d837bd4515fa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:43.547590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818fbd-2b5e-46be-9b8e-d837bd4515fa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:43.570845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:43.594639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:43.595288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:43.596089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:43.596369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:43.597191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:43.597622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:43.599779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:43.612409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 408/818] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:43.619855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:43.670219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:43.736113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe83d-4e71-48bd-bc2a-6aeae6014190 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:43.755640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:43.822434 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbe36-74f9-4ad9-a945-58d9a4682908 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:43.830545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:43.831343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:43.831745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:43.832117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:43.832810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:43.834634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:43.846794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:43.847995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 15:51:43.848842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:43.851335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 411/819] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Oct 3 15:51:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:43.861893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:43.914500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:43.915139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:43.915414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:43.915680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:43.938594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:43.940050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:43.967480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:43.969070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:43.970342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:43.970342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:43.970342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:43.970342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 409/820] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:43.977944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:43.987041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2886cb8-4f91-4dd8-804b-c5fe67e5e1e0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:44.027812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:44.028884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:44.029262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:44.029656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:44.031102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:44.031683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:44.033395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:44.044574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 412/821] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Oct 3 15:51:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:44.045709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:44.072061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:44.089642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:44.109646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d1c4-4adc-4f0e-9ea5-65c4e7c30af5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:44.151282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:44.152758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:44.153253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:44.153673 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:44.154602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:44.155058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:44.156588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:44.176566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 410/822] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:44.178342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:44.181293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68466df-dcde-46c8-a8b2-25ed4d1ee93a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:44.223521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:44.224244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:44.224597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:44.225539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:44.226219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:44.226587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:44.228007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:44.237969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 413/823] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Oct 3 15:51:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:44.238815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:44.302405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0d07c-5f19-467a-b744-0e9d7a319f75 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:44.338108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:44.341680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:44.344557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeafa0-cb25-463e-a14e-31ba5a1d0d30 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:44.344760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:44.345697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:44.346162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:44.346588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:44.355464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:44.357278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:44.369518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:44.370779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:51:44.371856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:44.373867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 411/824] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:51:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:44.381804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:44.384705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:44.385425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:44.385852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:44.386234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:44.387007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:44.388488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:44.472717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 414/825] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:51:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:44.498718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d514ff2-0c77-4643-898b-ef39288b9bec None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:44.547683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:44.548464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:44.548849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:44.549227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:44.550252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:44.550763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:44.552329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:44.578142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 412/826] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:51:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:44.580738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:44.698394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def4298-67de-42de-b36c-9903e39c0b0e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:44.740106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:44.741606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:44.742040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:44.742417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:44.768763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:44.816385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:44.818051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:44.929148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 415/827] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:51:44.931113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:44.988689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:45.046512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29cd23-3891-41f6-87fd-97f2001861f8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:45.082038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:45.082676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.083228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.083507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.095415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:45.096868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:45.112152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:45.113095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:45.114016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:45.114016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:45.114016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:45.117971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 413/828] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:45.119350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:45.177178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:45.224769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e9ad5-e66c-4074-9f6e-e01d0213b18d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:45.263648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d396c-8216-4cc3-af91-795627b33ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:45.264263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d396c-8216-4cc3-af91-795627b33ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.264551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d396c-8216-4cc3-af91-795627b33ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.264830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d396c-8216-4cc3-af91-795627b33ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.265478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d396c-8216-4cc3-af91-795627b33ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:45.265808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d396c-8216-4cc3-af91-795627b33ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:45.267195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d396c-8216-4cc3-af91-795627b33ce3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:45.284815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 416/829] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:45.286235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:45.342932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310325c5-4a52-478c-9340-f28db22c2d00 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.343235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310325c5-4a52-478c-9340-f28db22c2d00 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.343390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310325c5-4a52-478c-9340-f28db22c2d00 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.345130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 417/830] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:51:45.355504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c3f0-885c-4543-99c7-7bb73e531033 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.355789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c3f0-885c-4543-99c7-7bb73e531033 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.356264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5c3f0-885c-4543-99c7-7bb73e531033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.383852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cca5c3f0-885c-4543-99c7-7bb73e531033 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:45.385237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cca5c3f0-885c-4543-99c7-7bb73e531033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:45.409712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:45.413968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e663a-85ef-4cea-b419-13f87837a6e2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:45.453575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:45.454555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.454555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.454812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.463819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:45.465272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:45.479055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:45.480019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:45.480930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:45.485039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 414/831] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:45.485976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:45.494281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 418/832] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:45.601666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36615bd-39f3-47f1-a490-84abb2b80426 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:45.638288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fb133-fef9-4dd2-b194-efe0356c3f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:45.638895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb133-fef9-4dd2-b194-efe0356c3f7c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.639177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb133-fef9-4dd2-b194-efe0356c3f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.639449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fb133-fef9-4dd2-b194-efe0356c3f7c None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.640141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fb133-fef9-4dd2-b194-efe0356c3f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:45.640446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fb133-fef9-4dd2-b194-efe0356c3f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:45.641897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fb133-fef9-4dd2-b194-efe0356c3f7c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:45.658675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 415/833] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:45.667102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c3f0-885c-4543-99c7-7bb73e531033 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:45.694206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1e47-a072-4f14-91c6-2389f4b08cd0 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.694686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1e47-a072-4f14-91c6-2389f4b08cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.695162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f1e47-a072-4f14-91c6-2389f4b08cd0 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.698271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 416/834] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:51:45.704829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14d72-fe0f-414e-9953-2d8c5d4fc092 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.705506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14d72-fe0f-414e-9953-2d8c5d4fc092 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.706040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14d72-fe0f-414e-9953-2d8c5d4fc092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.730246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d1c14d72-fe0f-414e-9953-2d8c5d4fc092 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:45.732249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d1c14d72-fe0f-414e-9953-2d8c5d4fc092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:45.741980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:45.751212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:45.803177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5c3f0-885c-4543-99c7-7bb73e531033 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:45.815774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 417/835] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:45.816631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c14d72-fe0f-414e-9953-2d8c5d4fc092 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:45.841555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:45.842504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.842969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.843447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.844350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=5550726a2c5e4aff9c16f509a3d1bb0a) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:45.844851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:45.846546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:45.853479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 419/836] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:45 2022] GET /identity/v3/role_assignments?user.id=5550726a2c5e4aff9c16f509a3d1bb0a&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:45.940139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c14d72-fe0f-414e-9953-2d8c5d4fc092 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:45.982624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:45.983294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:45.983576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:45.983855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:45.996438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:46.001633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:46.002665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:46.004101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 418/837] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:46.009617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.127812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0420924-19a2-4b7b-9f40-7bb5d8d65a29 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.138637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:46.152820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.164535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.165262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.165551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.165863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.166120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:46.166537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:46.166913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.168657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.185412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 420/838] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:46.189655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.263739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbd8a3-a451-407c-b934-af4764d8f37b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.302397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6638fb-ac1b-42e9-b077-3da2cbf780f3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.304582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.305841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.306333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.306807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.317975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:46.323520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:46.324476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:51:46.325345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:46.332694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 419/839] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:46.334539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.342012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.342656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.342993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.343333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.357853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.359704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:46.380240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:46.381328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:46.382998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:46.382998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:46.382998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:46.385850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 421/840] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:46.388465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.422128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:46.430997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:46.466984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92808629-e64b-4dd6-9ae9-7ecc56ddceec None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.502263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2865-e11b-4a74-849c-8f62131361d5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.503059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.503891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.504395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.504861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.505717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:46.506329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.507976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.516946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 420/841] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:46.523966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.548171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.549111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.550122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.550627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.551709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:46.552493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.555013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.576188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 422/842] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:46.576787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.638672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d08df-7e17-41e8-938b-c4d810c8be48 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.670107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:46.678565 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.678565 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.682463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.682463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.691120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.692792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.700455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:46.711050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:46.712053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:46.712941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:46.712941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:46.712941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:46.719184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 421/843] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:46.719184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.741984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3179040-ea5d-4e47-b4a4-715f54a11d4c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.784925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a36e6-c1c9-4024-a159-acbf56478982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.785567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a36e6-c1c9-4024-a159-acbf56478982 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.785875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a36e6-c1c9-4024-a159-acbf56478982 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.786150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a36e6-c1c9-4024-a159-acbf56478982 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.795019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a36e6-c1c9-4024-a159-acbf56478982 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.796654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a36e6-c1c9-4024-a159-acbf56478982 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6a5a36e6-c1c9-4024-a159-acbf56478982 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:46.810637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:46.811600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 15:51:46.812561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:46.816037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 423/844] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:46.817851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1bfb9-1520-4c2e-bc4b-34bad37b18d8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.818144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1bfb9-1520-4c2e-bc4b-34bad37b18d8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.818426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1bfb9-1520-4c2e-bc4b-34bad37b18d8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.820021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 424/845] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:46.820629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1bfb9-1520-4c2e-bc4b-34bad37b18d8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:46.845867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8698ea-cd31-4dac-88df-03e41927ce77 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.881156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514395b-637c-4ae8-8ef9-ceaf5e04641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.881957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514395b-637c-4ae8-8ef9-ceaf5e04641e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.882329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514395b-637c-4ae8-8ef9-ceaf5e04641e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.882713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514395b-637c-4ae8-8ef9-ceaf5e04641e None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.883590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514395b-637c-4ae8-8ef9-ceaf5e04641e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:46.883995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514395b-637c-4ae8-8ef9-ceaf5e04641e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.885504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514395b-637c-4ae8-8ef9-ceaf5e04641e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.904097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 422/846] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:46.904097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58960-fceb-4d86-bf57-25b7b57cc1fd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.904097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58960-fceb-4d86-bf57-25b7b57cc1fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.904097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58960-fceb-4d86-bf57-25b7b57cc1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.920215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e4c58960-fceb-4d86-bf57-25b7b57cc1fd None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:46.921520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e4c58960-fceb-4d86-bf57-25b7b57cc1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:46.941510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1bfb9-1520-4c2e-bc4b-34bad37b18d8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:46.961777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:46.978251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:46.978860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:46.979145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:46.979422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:46.980202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:46.980512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:46.981976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:46.994149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 423/847] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:46.995056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c58960-fceb-4d86-bf57-25b7b57cc1fd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.010417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 425/848] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:47.016563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.020269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.120289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c58960-fceb-4d86-bf57-25b7b57cc1fd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.126379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4892a-50ca-4136-8239-66cc6edda262 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.158709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.159866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.160359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.160844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.167942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.168550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.168834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.169257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.170447 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.172176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:47.185562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:47.186567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:47.187502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:47.190100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 424/849] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:51:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:47.197427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.235123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.264133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.266401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.268482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.319487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec8ed-5843-4eeb-97f4-9cd07d8c3e21 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.357659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.358297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.358578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.358853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.359701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:47.360129 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.361620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.380267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 426/850] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:51:47.380267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.380596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 425/851] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:47.381587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.482263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.488931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447fcea-6374-4a06-a367-2e89d8304acf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.490783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.493329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cfcdd-c8e7-4d72-9323-9f161fd5ede4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.526039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.526817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.527121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.527401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.528556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.529973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.532132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.532762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.533043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.533390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:47.538811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:47.545264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:47.546375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 427/852] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:47.547215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.549675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.551808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:47.567695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:47.569649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:47.570612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:47.570612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:47.570612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:47.570612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 426/853] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:47.570612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.660412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7c79-e587-4cf4-93b2-85cbe5ed807c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.674303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba950ebc-028b-4e45-894a-f414d220d560 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.700188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.700905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.701191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.701467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.709999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.711336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.711336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.711336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.711736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:47.712038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.713407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.719190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 427/854] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:47.719190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.735381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.748757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.788348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.789834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.838026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1caffc-eef1-40d0-9dd9-e505aca3b71e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:47.875481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:47.876099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:47.876714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:47.877009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:47.877653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:47.877990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:47.879369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:47.892468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 428/855] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:47.893312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.909740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 428/856] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:51:47.909740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:47.969130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:47.979243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:48.009477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccabe2-cc8b-4e0e-8b3a-ee7ddb65eb1c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.016944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7674cc-f402-4313-acba-767bc00ec37c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.045796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.046740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.047032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.047310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.047957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:48.048379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.049802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.054916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.055572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.055855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.056127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.056674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 429/857] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:48.057551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.074729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.076601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:48.090351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:48.091337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:48.092234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:48.096623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 429/858] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:48.097532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.193515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c63b0d-c963-48b9-bc04-3f1c2de3218a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.227520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62caed-0d32-4f29-afb7-e49b3db7ec11 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.228382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:48.234482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ab99b-77da-42cb-937d-c7f175822007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.235138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ab99b-77da-42cb-937d-c7f175822007 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.235423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ab99b-77da-42cb-937d-c7f175822007 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.235709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ab99b-77da-42cb-937d-c7f175822007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.247106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ab99b-77da-42cb-937d-c7f175822007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.249314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ab99b-77da-42cb-937d-c7f175822007 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.255722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:48.269880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d49dd-dbad-4026-98d3-05ac389f136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-336ab99b-77da-42cb-937d-c7f175822007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:48.270081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:48.271185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:48.272930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:48.272930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:48.272930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:48.273115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d49dd-dbad-4026-98d3-05ac389f136f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.273115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d49dd-dbad-4026-98d3-05ac389f136f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.273115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d49dd-dbad-4026-98d3-05ac389f136f None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.273115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d49dd-dbad-4026-98d3-05ac389f136f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:48.273115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d49dd-dbad-4026-98d3-05ac389f136f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.274140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 430/859] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:48.274245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d49dd-dbad-4026-98d3-05ac389f136f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.274342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bce6-63b8-4ccd-a330-36ef6caa334a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.274342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bce6-63b8-4ccd-a330-36ef6caa334a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.274342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bce6-63b8-4ccd-a330-36ef6caa334a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.274342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 431/860] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:48.274717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bce6-63b8-4ccd-a330-36ef6caa334a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.287827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 430/861] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:48.289096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5364-3ef4-4d32-aea6-1b0cc1a1dbf5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.289378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5364-3ef4-4d32-aea6-1b0cc1a1dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.290072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b5364-3ef4-4d32-aea6-1b0cc1a1dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.309017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3c0b5364-3ef4-4d32-aea6-1b0cc1a1dbf5 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:48.310227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3c0b5364-3ef4-4d32-aea6-1b0cc1a1dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:48.389785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bce6-63b8-4ccd-a330-36ef6caa334a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.390297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 431/862] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:48.390852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b5364-3ef4-4d32-aea6-1b0cc1a1dbf5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.423285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.423889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.424167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.424441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.425135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:48.425440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.427058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.440117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 432/863] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:48.445350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.497851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:48.538095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b5364-3ef4-4d32-aea6-1b0cc1a1dbf5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.547449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:48.566768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.567383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.567674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.567949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.568747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a21de1ac06b8422fa33aae8a1ad4bcf2) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:48.569066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.570823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.577338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 432/864] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/role_assignments?user.id=a21de1ac06b8422fa33aae8a1ad4bcf2&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:48.580195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9dca50-4e09-4a50-aad8-b60f64e7234f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.624036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.625182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.625675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.626193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.634835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.636726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:48.651376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:48.652405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:48.653375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:48.656127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 433/865] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:48.657206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.664057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.770433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51f76-2001-4d7e-822d-2fbb971c2931 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.787579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942482e-9c2d-4686-bcb5-152cf5f180e2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.792508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:48.811769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.813264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.813692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.814062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.814727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.816164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:48.828006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:48.829217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:48.830337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:48.831185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 433/866] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:48.837693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.839702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.840324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.840602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.840869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.841560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:48.841898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.843327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:48.856356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 434/867] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:48.863677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:48.892800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:48.953949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d917b-c73a-4593-ad1d-5b85f2fe3747 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.977426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d1ca9-590e-4afe-9b16-f4a375639aaa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:48.991041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:48.991673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:48.991959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:48.992243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:48.992902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:48.993204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:48.994666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:49.000319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 434/868] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:49.005488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:49.020669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46588d0d-410e-4b48-964d-0d555c1592a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:49.021676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588d0d-410e-4b48-964d-0d555c1592a9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:49.022212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588d0d-410e-4b48-964d-0d555c1592a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:49.022745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588d0d-410e-4b48-964d-0d555c1592a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:49.023630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46588d0d-410e-4b48-964d-0d555c1592a9 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a977434e408a4fac94b0757de67c97cc) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:49.024088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46588d0d-410e-4b48-964d-0d555c1592a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:49.025805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46588d0d-410e-4b48-964d-0d555c1592a9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:49.037937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 435/869] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:48 2022] GET /identity/v3/role_assignments?user.id=a977434e408a4fac94b0757de67c97cc&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:49.122921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c86e6-2374-4ed7-9d27-de6400a4a643 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:49.139185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:49.159815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46090-20e8-44c1-be7c-6c23592bf5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:49.160440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46090-20e8-44c1-be7c-6c23592bf5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:49.160723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46090-20e8-44c1-be7c-6c23592bf5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:49.161000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46090-20e8-44c1-be7c-6c23592bf5d3 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:49.161641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf46090-20e8-44c1-be7c-6c23592bf5d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:49.161978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf46090-20e8-44c1-be7c-6c23592bf5d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:49.163918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf46090-20e8-44c1-be7c-6c23592bf5d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:49.169475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 435/870] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:50.284510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e854a1-7ff6-46dc-b4ee-3e3a55a5eb44 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:50.285029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e854a1-7ff6-46dc-b4ee-3e3a55a5eb44 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:50.285130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e854a1-7ff6-46dc-b4ee-3e3a55a5eb44 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:50.286629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 436/871] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:50.292542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb0371-1383-4b85-8b82-73406ecd5155 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:50.292956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb0371-1383-4b85-8b82-73406ecd5155 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:50.293133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb0371-1383-4b85-8b82-73406ecd5155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:50.311889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-acfb0371-1383-4b85-8b82-73406ecd5155 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:50.313061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-acfb0371-1383-4b85-8b82-73406ecd5155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:50.383804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 436/872] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:50.653894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e854a1-7ff6-46dc-b4ee-3e3a55a5eb44 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:50.681851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:50.773039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e854a1-7ff6-46dc-b4ee-3e3a55a5eb44 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:50.812703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946b7d0-2bcb-4217-a743-d8ff7d98dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:50.813562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946b7d0-2bcb-4217-a743-d8ff7d98dec4 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:50.814027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946b7d0-2bcb-4217-a743-d8ff7d98dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:50.814452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946b7d0-2bcb-4217-a743-d8ff7d98dec4 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:50.815296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946b7d0-2bcb-4217-a743-d8ff7d98dec4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:50.816829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946b7d0-2bcb-4217-a743-d8ff7d98dec4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:50.885491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 437/873] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:51:50 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:50.890622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5b712-223d-4ea1-922f-908f69347cbe None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:50.890622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5b712-223d-4ea1-922f-908f69347cbe None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:50.890622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5b712-223d-4ea1-922f-908f69347cbe None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:50.890622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 437/874] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:50.895289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d879a-af2c-4886-a17a-bd65559a0950 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:50.899191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d879a-af2c-4886-a17a-bd65559a0950 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:50.899191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d879a-af2c-4886-a17a-bd65559a0950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:50.918779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8b5d879a-af2c-4886-a17a-bd65559a0950 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:50.920352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8b5d879a-af2c-4886-a17a-bd65559a0950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:51.007872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 438/875] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:50 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:51.278189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5b712-223d-4ea1-922f-908f69347cbe None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:51.395533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5b712-223d-4ea1-922f-908f69347cbe None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:51.397202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:51.410893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ec16-e549-4436-bf4b-ab396a0fbedb None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:51.411827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ec16-e549-4436-bf4b-ab396a0fbedb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:51.412837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ec16-e549-4436-bf4b-ab396a0fbedb None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:51.414687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 439/876] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:51.420204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403555b-18ea-41e2-bd19-8008f73fbc19 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:51.420495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403555b-18ea-41e2-bd19-8008f73fbc19 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:51.420844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403555b-18ea-41e2-bd19-8008f73fbc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:51.438440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:51.439150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:51.439438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:51.439712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:51.440297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:51.441634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9403555b-18ea-41e2-bd19-8008f73fbc19 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:51.441745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:51.443142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9403555b-18ea-41e2-bd19-8008f73fbc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:51.452287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:51.455394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:51.456358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:51:51.457206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:51.461421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 438/877] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:51.467145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:51.529925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 440/878] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:51.531349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b54f6-1156-4521-80ce-d9b746b29b9a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:51.531641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b54f6-1156-4521-80ce-d9b746b29b9a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:51.531921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b54f6-1156-4521-80ce-d9b746b29b9a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:51.533300 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 441/879] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:51.539415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515e9ab-fc77-47bb-a9b8-9d0a0977f5a3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:51.539971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515e9ab-fc77-47bb-a9b8-9d0a0977f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:51.540669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515e9ab-fc77-47bb-a9b8-9d0a0977f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:51.566875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4515e9ab-fc77-47bb-a9b8-9d0a0977f5a3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:51.569361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4515e9ab-fc77-47bb-a9b8-9d0a0977f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:51.587991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed1fa0-e7e4-43bc-9ddc-597fdb5887f2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:51.631237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:51.631952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:51.632344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:51.632626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:51.633273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:51.633666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:51.635132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:51.640889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 439/880] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:51:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:51.646286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:51.663584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 442/881] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:51.690633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:51.781654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064466c6-a508-4959-8972-1b4478a82b96 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:51.824366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515e9ab-fc77-47bb-a9b8-9d0a0977f5a3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:51.826259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:51.827075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:51.827360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:51.827630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:51.829154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:51.829461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:51.830938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:51.837952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 440/882] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:51:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:51.930677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:51.960968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:51.976921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515e9ab-fc77-47bb-a9b8-9d0a0977f5a3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:52.035601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:52.036891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:52.038150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:52.038886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:52.052734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:52.060275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:52.061272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:52.062204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 443/883] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Oct 3 15:51:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:52.068070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:52.093333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:52.107526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5792305-e474-489f-97ee-1fbed9acf4df None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:52.154597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:52.155373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:52.155776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:52.156060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:52.156729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:52.158134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:52.203028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfede8b-7fd1-42d7-8688-644ffb5c722b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:52.234355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 441/884] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:51:51 2022] POST /identity/v3/services => generated 269 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:52.244516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:52.258393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:52.259025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:52.259307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:52.259581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:52.260372 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:52.260678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:52.262241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:52.277550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 444/885] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Oct 3 15:51:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:52.284355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:52.426283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7da9a-db14-436f-8c17-62eda5f3c902 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:52.475595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:52.476262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:52.476547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:52.476826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:52.493667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:52.495195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:52.516416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:52.517456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:52.518493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:52.518493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:52.518493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:52.519082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 442/886] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:52.524632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:52.642074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58047e-8877-4d45-a280-db99a7084e33 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:52.680861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:52.681713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:52.682188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:52.682668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:52.683507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:52.683968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:52.685507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:52.699032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 445/887] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:52.705194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:52.715511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:52.822629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e187a2-d259-4fb8-97fa-7726429f6bcc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:52.859581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:52.860228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:52.860513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:52.860787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:52.869406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:52.870889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:52.882880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:52.883914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:52.884899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 443/888] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:51:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:52.890445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:52.946483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:53.002066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e153f-e706-478c-917a-570553a77e1f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:53.038873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111d46a-0053-449c-b947-e49d1b00e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:53.039476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d46a-0053-449c-b947-e49d1b00e838 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.039767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d46a-0053-449c-b947-e49d1b00e838 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.040085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d46a-0053-449c-b947-e49d1b00e838 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.040824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111d46a-0053-449c-b947-e49d1b00e838 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:53.041134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111d46a-0053-449c-b947-e49d1b00e838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:53.042639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111d46a-0053-449c-b947-e49d1b00e838 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:53.063472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 446/889] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Oct 3 15:51:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:53.071261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:53.149571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:53.185553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03afc3-a6c6-480b-ab6c-ad0241bbb615 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:53.224401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:53.225516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.225830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.226107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.301923 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:53.304033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:53.327530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6148-df72-408f-846b-bc5d2f2752d7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.327945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6148-df72-408f-846b-bc5d2f2752d7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.328304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6148-df72-408f-846b-bc5d2f2752d7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.329841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 447/890] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:53.337666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd3bc-34a6-43f0-b969-cfe92040a0b2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.338198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd3bc-34a6-43f0-b969-cfe92040a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.338777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd3bc-34a6-43f0-b969-cfe92040a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.361867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4e3cd3bc-34a6-43f0-b969-cfe92040a0b2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:53.364031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e3cd3bc-34a6-43f0-b969-cfe92040a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:53.374484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:53.417845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 444/891] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:51:53 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:51:53.421649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:53.469886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 448/892] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:53.535617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29c39b-76f5-4e17-b052-35e94903b015 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:53.572372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:53.573349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.573847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.574315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.585463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:53.587184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:53.602314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:53.603281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:53.604165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:53.604165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:53.604165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:53.610827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 445/893] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:53.612500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd3bc-34a6-43f0-b969-cfe92040a0b2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:53.655722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:53.732940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd3bc-34a6-43f0-b969-cfe92040a0b2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:53.750368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:53.772043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:53.776916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:53.777793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.778377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.779163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.780293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:53.780788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:53.783147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:53.805321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 449/894] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:53.806940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:53.872942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b1fc-a82e-4e02-9629-429b48a461b9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:53.909057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:53.909747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.910023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.910341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.910923 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:53.912302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:53.921355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:53.922413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:53.923243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:53.927283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 446/895] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:53.929010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:53.931468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:53.936871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811067a8-74e8-42dc-8682-3c49209b9503 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:53.978865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:53.979484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:53.979772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:53.980026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:53.986979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:53.988483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:54.000389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:54.001335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:54.002258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:54.006654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 450/896] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:54.007524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:54.039890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:54.058627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f57569-2a0d-4e6a-b712-20b8d0fd1e24 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:54.095887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:54.096102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.096367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.096621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.097331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:54.097647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:54.099220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.110335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 447/897] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:54.112015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:54.138931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797631ca-2d08-4cc9-b4ad-6bbb123fc858 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:54.184354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:54.185747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.186518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.186979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.188008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:54.188503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:54.190929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.210596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 451/898] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:54.212177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:54.226446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a88e1-6685-4950-a686-696ad8675a8f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:54.233889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:54.262109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754ff37-8b2b-492f-b977-536536e94070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:54.262764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754ff37-8b2b-492f-b977-536536e94070 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.263047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754ff37-8b2b-492f-b977-536536e94070 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.263379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754ff37-8b2b-492f-b977-536536e94070 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.264015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754ff37-8b2b-492f-b977-536536e94070 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:54.264328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754ff37-8b2b-492f-b977-536536e94070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:54.265747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754ff37-8b2b-492f-b977-536536e94070 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.274778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 448/899] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:54.274778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15899487-3ec2-44d0-864f-a7b3d6f28864 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.274778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15899487-3ec2-44d0-864f-a7b3d6f28864 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.274778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15899487-3ec2-44d0-864f-a7b3d6f28864 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.274778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 449/900] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:54.279010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15899487-3ec2-44d0-864f-a7b3d6f28864 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:54.291098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:54.326165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e1c7d-0c6c-462a-a3a8-dfac535d3084 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:54.363321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5df2b-d416-4413-b7c8-c866909e377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:54.363933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5df2b-d416-4413-b7c8-c866909e377e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.364218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5df2b-d416-4413-b7c8-c866909e377e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.364490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5df2b-d416-4413-b7c8-c866909e377e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.365237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5df2b-d416-4413-b7c8-c866909e377e None admin] RBAC: Adding query filter params (role.id=89d893f48d1c4858a86af30d5d6c779f, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a977434e408a4fac94b0757de67c97cc) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:54.365548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5df2b-d416-4413-b7c8-c866909e377e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:54.367070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5df2b-d416-4413-b7c8-c866909e377e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.372704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 452/901] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:51:54 2022] GET /identity/v3/role_assignments?user.id=a977434e408a4fac94b0757de67c97cc&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=89d893f48d1c4858a86af30d5d6c779f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:54.373977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a7d9-e0b5-4fba-9ddb-effcf91acee3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.374266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a7d9-e0b5-4fba-9ddb-effcf91acee3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.374542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527a7d9-e0b5-4fba-9ddb-effcf91acee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.397156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1527a7d9-e0b5-4fba-9ddb-effcf91acee3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:54.400314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1527a7d9-e0b5-4fba-9ddb-effcf91acee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:54.400467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15899487-3ec2-44d0-864f-a7b3d6f28864 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:54.447000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:54.447734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.448021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.448503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.449278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] RBAC: Adding query filter params (interface=public, service_id=fd04206abc4c4953bc4dacbabbeb49c2, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:54.449841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:54.451611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.466064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 450/902] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:51:54 2022] GET /identity/v3/endpoints?service_id=fd04206abc4c4953bc4dacbabbeb49c2&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:54.467867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:54.507836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 453/903] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:54.560122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:54.573888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6b71c-3ba5-46b5-9adf-f38c465aaa37 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.574491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6b71c-3ba5-46b5-9adf-f38c465aaa37 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.575432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6b71c-3ba5-46b5-9adf-f38c465aaa37 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.577549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 454/904] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:54.582983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5194d-69a4-4c04-9766-96e52c9f1086 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.584070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5194d-69a4-4c04-9766-96e52c9f1086 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.585211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5194d-69a4-4c04-9766-96e52c9f1086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.592265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a741d0-3ab7-472c-a966-48c9186f3437 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:54.609548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9fb5194d-69a4-4c04-9766-96e52c9f1086 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:54.611485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9fb5194d-69a4-4c04-9766-96e52c9f1086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:54.621461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:54.632730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:54.633540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.635055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.635055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.635055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:54.636711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.643110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 451/905] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:51:54 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 15:51:54.699259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 455/906] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:51:54.803566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:54.909475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b10ef3-cb34-4131-837d-f8e94d68efe3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:54.944113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:54.944726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:54.945010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:54.945347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:54.946051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:54.947490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:54.988135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5194d-69a4-4c04-9766-96e52c9f1086 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:55.005729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:55.021883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 452/907] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:51:54 2022] POST /identity/v3/services => generated 241 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:55.114770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5194d-69a4-4c04-9766-96e52c9f1086 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:55.159716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:55.160272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:55.160548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:55.160888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:55.161533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:55.163504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:55.173592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:55.174645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:55.175553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:55.176281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 456/908] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Oct 3 15:51:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:55.182361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:55.295854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ff757-4476-40b9-9fd3-44bd6c210f0e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:55.334732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:55.335536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:55.335817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:55.336091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:55.336724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:55.337026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:55.338430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:55.348234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 453/909] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:55.350240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:55.356352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:55.461613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a615f-1251-4045-aeb4-3914e1442574 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:55.495741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:55.496344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:55.496620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:55.496892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:55.497517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:55.497846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:55.499221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:55.509704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 457/910] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:55.511071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:55.577267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:55.621703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27313-a05f-46a3-8822-928425a32b3a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:55.657390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdd156-73fd-4a23-b6f1-39ba7d39e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:55.658153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdd156-73fd-4a23-b6f1-39ba7d39e4cc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:55.658446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdd156-73fd-4a23-b6f1-39ba7d39e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:55.658721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdd156-73fd-4a23-b6f1-39ba7d39e4cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:55.659425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdd156-73fd-4a23-b6f1-39ba7d39e4cc None admin] RBAC: Adding query filter params (interface=public, service_id=c30a141f1ced42608da458e1f7c8686b, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:55.659735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdd156-73fd-4a23-b6f1-39ba7d39e4cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:55.661100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdd156-73fd-4a23-b6f1-39ba7d39e4cc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:55.666718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 454/911] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:51:55 2022] GET /identity/v3/endpoints?service_id=c30a141f1ced42608da458e1f7c8686b&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:55.672153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:55.744298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:55.781004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3d6f-b256-4679-98d7-cb936437ba1a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:55.816325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ff41-5372-4371-91be-a7114644745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:55.816938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ff41-5372-4371-91be-a7114644745b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:55.817278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ff41-5372-4371-91be-a7114644745b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:55.817560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ff41-5372-4371-91be-a7114644745b None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:55.818198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1ff41-5372-4371-91be-a7114644745b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:55.820368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1ff41-5372-4371-91be-a7114644745b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:55.826810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 458/912] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:51:55 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 15:51:56.645324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff2de-b36a-4f79-ad74-3b6d96e8b175 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:56.645894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff2de-b36a-4f79-ad74-3b6d96e8b175 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:56.645894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff2de-b36a-4f79-ad74-3b6d96e8b175 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:56.647402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 455/913] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:56.652686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5796-8531-4749-b2a4-a49fc199813e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:56.652979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5796-8531-4749-b2a4-a49fc199813e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:56.653518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b5796-8531-4749-b2a4-a49fc199813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:56.673484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ed7b5796-8531-4749-b2a4-a49fc199813e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:56.675433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ed7b5796-8531-4749-b2a4-a49fc199813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:56.749178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 459/914] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:56.949436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be190-5f1b-480b-8de2-789c595c5f64 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:56.949810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be190-5f1b-480b-8de2-789c595c5f64 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:56.950006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be190-5f1b-480b-8de2-789c595c5f64 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:56.951406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 456/915] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:56.956948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0963cd-f21f-47fb-ad7b-99a2b0f42cc9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:56.957493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0963cd-f21f-47fb-ad7b-99a2b0f42cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:56.958005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0963cd-f21f-47fb-ad7b-99a2b0f42cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:56.978628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7c0963cd-f21f-47fb-ad7b-99a2b0f42cc9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:56.980123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7c0963cd-f21f-47fb-ad7b-99a2b0f42cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:57.026553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be190-5f1b-480b-8de2-789c595c5f64 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.043722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:57.059978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 460/916] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:57.145178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be190-5f1b-480b-8de2-789c595c5f64 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:57.175988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:57.185373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:57.186295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.186407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.186667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.197113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:51:57.202085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:57.203005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:57.204218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 457/917] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:57.210276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0963cd-f21f-47fb-ad7b-99a2b0f42cc9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.318237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0963cd-f21f-47fb-ad7b-99a2b0f42cc9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:57.360920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:57.361540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.361853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.362136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.362806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:57.363112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:57.364572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:57.365169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.377800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 461/918] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:57.381514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.442078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:57.495672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbaa21-f327-4632-a331-6cb433759920 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:57.495881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256812e2-56b9-464b-808e-b31f35a13991 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:57.532815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc42325-1735-4e2c-baba-0e0766b10d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:57.533451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42325-1735-4e2c-baba-0e0766b10d1f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.533735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42325-1735-4e2c-baba-0e0766b10d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.534043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc42325-1735-4e2c-baba-0e0766b10d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.534367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68152823-58c9-4baf-87c4-3858fabe8035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:57.534995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152823-58c9-4baf-87c4-3858fabe8035 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.535279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152823-58c9-4baf-87c4-3858fabe8035 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.535557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152823-58c9-4baf-87c4-3858fabe8035 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.536138 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68152823-58c9-4baf-87c4-3858fabe8035 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:57.537542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68152823-58c9-4baf-87c4-3858fabe8035 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:57.545689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc42325-1735-4e2c-baba-0e0766b10d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-68152823-58c9-4baf-87c4-3858fabe8035 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:57.546675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:57.547642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 15:51:57.548490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:57.549814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc42325-1735-4e2c-baba-0e0766b10d1f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:57.549892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 458/919] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:57.549892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c93678-ef52-4631-9513-e5ab52462b4a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.550266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c93678-ef52-4631-9513-e5ab52462b4a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.550548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c93678-ef52-4631-9513-e5ab52462b4a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.551941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 459/920] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:57.554953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c93678-ef52-4631-9513-e5ab52462b4a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-dbc42325-1735-4e2c-baba-0e0766b10d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:57.573735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:57.574764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:57.575635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:57.575635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:57.575635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:57.576302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 462/921] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:57.577154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed05f-dbea-4b0f-a8fa-06e55096f334 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.577446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed05f-dbea-4b0f-a8fa-06e55096f334 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.577725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed05f-dbea-4b0f-a8fa-06e55096f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.598200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-81fed05f-dbea-4b0f-a8fa-06e55096f334 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:57.599382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-81fed05f-dbea-4b0f-a8fa-06e55096f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:57.613716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:57.670159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c93678-ef52-4631-9513-e5ab52462b4a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:57.679330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 463/922] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:57.681280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed05f-dbea-4b0f-a8fa-06e55096f334 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.706498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:57.707403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.707883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.708610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.710078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:57.710608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:57.712159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:57.717242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 460/923] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:57.722827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.741989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:57.830332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9ff37-ae55-420c-a8a5-f8051e8047c2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:57.835683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed05f-dbea-4b0f-a8fa-06e55096f334 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:57.846139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:57.869274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:57.870188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.870644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.871061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.871837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:57.872284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:57.874104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:57.880560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 461/924] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:57.888556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:57.893695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6877-1332-495f-9509-0048500a9178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:57.894545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6877-1332-495f-9509-0048500a9178 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:57.895075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6877-1332-495f-9509-0048500a9178 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:57.895561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6877-1332-495f-9509-0048500a9178 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:57.897014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6877-1332-495f-9509-0048500a9178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:57.897540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6877-1332-495f-9509-0048500a9178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:57.899208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6877-1332-495f-9509-0048500a9178 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:57.911504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 464/925] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:57.917399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6877-1332-495f-9509-0048500a9178 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.024637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.028761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c1152-096c-42b4-9507-a1713c722250 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.031700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6877-1332-495f-9509-0048500a9178 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.066028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16bc79-8a78-46b4-89a8-db7114b33257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.066643 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16bc79-8a78-46b4-89a8-db7114b33257 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.066927 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16bc79-8a78-46b4-89a8-db7114b33257 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.067203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16bc79-8a78-46b4-89a8-db7114b33257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.067303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.067875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16bc79-8a78-46b4-89a8-db7114b33257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.067987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.068218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.068538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.069426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16bc79-8a78-46b4-89a8-db7114b33257 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.075861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.077294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:51:58.089157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:58.090267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 465/926] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:51:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:51:58.097085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.166176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 462/927] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:51:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:58.167253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4c05e-590c-492e-a194-99c02c2998af None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.167541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4c05e-590c-492e-a194-99c02c2998af None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.167821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4c05e-590c-492e-a194-99c02c2998af None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.169803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 463/928] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:51:58.170164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4c05e-590c-492e-a194-99c02c2998af None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.201027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a71e8-e2e8-4ce5-98e9-6040b1c34c6d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.222374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.261741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fa4be-32e7-4ff0-86ee-ec68570cd832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.263857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa4be-32e7-4ff0-86ee-ec68570cd832 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.264577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa4be-32e7-4ff0-86ee-ec68570cd832 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.265972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa4be-32e7-4ff0-86ee-ec68570cd832 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.266950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fa4be-32e7-4ff0-86ee-ec68570cd832 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.270003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fa4be-32e7-4ff0-86ee-ec68570cd832 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-db6fa4be-32e7-4ff0-86ee-ec68570cd832 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:58.283526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:58.284701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:51:58.285553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:58.286334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 466/929] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:58.287507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8ccb-5596-4c48-aef3-06e03d5a5714 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.287791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8ccb-5596-4c48-aef3-06e03d5a5714 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.288228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b8ccb-5596-4c48-aef3-06e03d5a5714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.307328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0e7b8ccb-5596-4c48-aef3-06e03d5a5714 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:51:58.307660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4c05e-590c-492e-a194-99c02c2998af None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.308536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e7b8ccb-5596-4c48-aef3-06e03d5a5714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:51:58.319598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.348432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.349144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.350535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.351132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.352063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:58.352605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.354391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.374449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 464/930] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:58.375302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.389802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 467/931] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:51:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:51:58.389802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8ccb-5596-4c48-aef3-06e03d5a5714 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.489967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.500341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571cb33-8ff8-4981-b517-87c275f67e8b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.505884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b8ccb-5596-4c48-aef3-06e03d5a5714 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.542407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.543031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.543317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.543651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.544296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:58.544609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.545098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.545734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.546043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.546145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.546304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.551753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 465/932] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:58.557309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.557480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.558971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.562107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:51:58.576376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:58.577366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:51:58.579513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:51:58.579513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:51:58.579513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:51:58.579513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 468/933] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:58.583685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.671906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86db288-bfe0-431f-a70a-f6324c89e199 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.695735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15334f-0e8c-4208-8d3f-672caf949a2f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.709798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.710699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.710699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.710950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.711567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:58.711979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.713229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.725947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 466/934] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:51:58.726817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.741375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.742026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.743871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.743871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.743871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:58.743871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.744870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.752357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.757926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 469/935] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:58.762922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.817087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:58.842492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a73c0-c097-4286-a5fb-19196eec40c9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.864158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48204f02-b599-4978-8cde-9d8991e53325 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:58.881048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.881684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.881992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.882268 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.882875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.884206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:58.893357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:58.894316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:58.895208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 467/936] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:58.896003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.905067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:58.905692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:58.906012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:58.906295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:58.907006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] RBAC: Adding query filter params (interface=public, service_id=12daba708d7e4824b571836c14a7155f, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:58.907322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:58.908693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:58.915070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 470/937] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/endpoints?service_id=12daba708d7e4824b571836c14a7155f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:58.915950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:58.994499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.011591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5445fd-790f-4995-9816-6559361b36ed None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:59.026444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e68c1-2c2d-4587-9937-76e993ecdc73 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:59.047463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.051264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:59.051932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:59.052230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:59.052489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:59.059703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:59.061197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:59.061471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:59.062107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:59.062387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:59.062659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:59.063285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:59.063591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:59.064932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:59.075841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 471/938] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:59.075841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:51:59.076087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:51:59.076934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 468/939] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:51:59.078474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:59.182961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a053-7790-4d52-a554-c48077e2744e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:59.195611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfd845-5f75-4c82-8869-8d48236d9eff None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:59.216272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:59.216872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:59.217152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:59.217426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:59.218050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:59.219413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:59.225206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 472/940] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:51:59 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 15:51:59.226795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:59.235215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:59.236251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:59.236785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:59.237260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:59.238221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:59.238740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:59.241973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:59.253522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 469/941] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:51:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:59.254831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:59.270041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.308618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.369370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02319a-82ea-4f85-835a-7e1281c2b43d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:59.390788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1062c-e1ed-4b4a-8d3a-85da6dd0d833 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:59.408280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:59.408898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:59.409178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:59.409454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:59.410198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:51:59.410716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:59.411937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:59.429662 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 473/942] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:51:59.434953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:51:59.437287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3df0f4-2de9-407f-90f9-c9ffc26dc5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:59.438046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df0f4-2de9-407f-90f9-c9ffc26dc5ca None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:59.438696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df0f4-2de9-407f-90f9-c9ffc26dc5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:59.439072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df0f4-2de9-407f-90f9-c9ffc26dc5ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:59.440690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3df0f4-2de9-407f-90f9-c9ffc26dc5ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:59.442109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3df0f4-2de9-407f-90f9-c9ffc26dc5ca None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:59.534084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 470/943] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:51:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:51:59.554196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e4b2e-e811-40e6-9ca3-7b22997ca70c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:51:59.566085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:51:59.604496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f5e78-d361-4c21-bd64-c41df4ac39a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:51:59.605191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f5e78-d361-4c21-bd64-c41df4ac39a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:51:59.605471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f5e78-d361-4c21-bd64-c41df4ac39a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:51:59.605753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f5e78-d361-4c21-bd64-c41df4ac39a2 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a977434e408a4fac94b0757de67c97cc/roles/89d893f48d1c4858a86af30d5d6c779f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:51:59.608259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f5e78-d361-4c21-bd64-c41df4ac39a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=a977434e408a4fac94b0757de67c97cc, role_id=89d893f48d1c4858a86af30d5d6c779f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:51:59.610751 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f5e78-d361-4c21-bd64-c41df4ac39a2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:51:59.681560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 474/944] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:51:59 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/a977434e408a4fac94b0757de67c97cc/roles/89d893f48d1c4858a86af30d5d6c779f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:52:00.464707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d199c-2539-4d71-b0ef-68ffc889fcfe None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:00.465275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d199c-2539-4d71-b0ef-68ffc889fcfe None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:00.465275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d199c-2539-4d71-b0ef-68ffc889fcfe None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:00.466878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 471/945] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:00.472790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2eda-1362-4a94-ae28-3e1e338e3065 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:00.473216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2eda-1362-4a94-ae28-3e1e338e3065 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:00.473314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b2eda-1362-4a94-ae28-3e1e338e3065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:00.491965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c55b2eda-1362-4a94-ae28-3e1e338e3065 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:00.493217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c55b2eda-1362-4a94-ae28-3e1e338e3065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:00.562912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 475/946] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:00.835161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d199c-2539-4d71-b0ef-68ffc889fcfe None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:00.901015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:00.946220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d199c-2539-4d71-b0ef-68ffc889fcfe None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:00.983983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:00.984546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:00.984830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:00.985104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:00.985802 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:00.987236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:00.989882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING keystone.server.flask.common [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 03 15:52:01.045119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.sql.core [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 15:52:01.045119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 15:52:01.045119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [parameters: {'id': '7f4f2bdc47324a4b9aa3189e86984929', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 15:52:01.045119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81563) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f4f2bdc47324a4b9aa3189e86984929.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f4f2bdc47324a4b9aa3189e86984929. Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 15:52:01.053650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 03 15:52:01.054474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application yield resource Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise self.value Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application session.commit() Oct 03 15:52:01.055837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.flush() Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application compat.raise_( Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 15:52:01.056832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 15:52:01.057726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 15:52:01.058575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [parameters: {'id': '7f4f2bdc47324a4b9aa3189e86984929', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:01.059502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:01.060349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7f4f2bdc47324a4b9aa3189e86984929. Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:01.066650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 472/947] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Oct 3 15:52:00 2022] POST /identity/v3/projects => generated 262 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:01.067346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b2eda-1362-4a94-ae28-3e1e338e3065 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:01.159793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:01.167122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b2eda-1362-4a94-ae28-3e1e338e3065 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:01.201896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab9728-deb7-4304-af01-1f55ddad77cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:01.202532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9728-deb7-4304-af01-1f55ddad77cc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:01.202865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9728-deb7-4304-af01-1f55ddad77cc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:01.203254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab9728-deb7-4304-af01-1f55ddad77cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:01.210769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab9728-deb7-4304-af01-1f55ddad77cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:01.212603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab9728-deb7-4304-af01-1f55ddad77cc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5aab9728-deb7-4304-af01-1f55ddad77cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:52:01.224234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:01.232167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:01.234102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 476/948] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:01.234702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:01.366190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9957-c5d6-441c-bb2c-8206292c367d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:01.390250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:01.404346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4fe7c-f4dc-415d-a2b4-795861755c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:01.404961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4fe7c-f4dc-415d-a2b4-795861755c00 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:01.405244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4fe7c-f4dc-415d-a2b4-795861755c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:01.405522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4fe7c-f4dc-415d-a2b4-795861755c00 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:01.406220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4fe7c-f4dc-415d-a2b4-795861755c00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:01.406530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4fe7c-f4dc-415d-a2b4-795861755c00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:01.408241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4fe7c-f4dc-415d-a2b4-795861755c00 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:01.430247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 473/949] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:52:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:01.622476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58990c-0a86-4e56-8d2c-ef1afa25f0f1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:01.623190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58990c-0a86-4e56-8d2c-ef1afa25f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:01.623190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58990c-0a86-4e56-8d2c-ef1afa25f0f1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:01.624504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 477/950] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:01.629946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066dab-9513-4972-be68-0b842f541578 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:01.630455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066dab-9513-4972-be68-0b842f541578 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:01.630606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066dab-9513-4972-be68-0b842f541578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:01.652742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a8066dab-9513-4972-be68-0b842f541578 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:01.654352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a8066dab-9513-4972-be68-0b842f541578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:01.747048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 474/951] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:01.823024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c131e-825f-49d7-91a2-bbd41eae7daa None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:01.823432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c131e-825f-49d7-91a2-bbd41eae7daa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:01.823601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c131e-825f-49d7-91a2-bbd41eae7daa None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:01.825023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 478/952] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:01.834244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680ff6-648b-441c-bac0-7491922cce97 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:01.834244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680ff6-648b-441c-bac0-7491922cce97 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:01.834244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680ff6-648b-441c-bac0-7491922cce97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:01.850792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c8680ff6-648b-441c-bac0-7491922cce97 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:01.852376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c8680ff6-648b-441c-bac0-7491922cce97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:01.929922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 475/953] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:02.011685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a85b-ccf4-45d0-b446-b380726f2908 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.012642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a85b-ccf4-45d0-b446-b380726f2908 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.013349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a85b-ccf4-45d0-b446-b380726f2908 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.015531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 479/954] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:02.022701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda910-fde0-42c0-876f-a7a4e51ff594 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.023367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda910-fde0-42c0-876f-a7a4e51ff594 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.023928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eda910-fde0-42c0-876f-a7a4e51ff594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.033072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937a85b-ccf4-45d0-b446-b380726f2908 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.047659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-83eda910-fde0-42c0-876f-a7a4e51ff594 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:02.049019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-83eda910-fde0-42c0-876f-a7a4e51ff594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:02.088490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:02.126798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 476/955] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:02.170404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937a85b-ccf4-45d0-b446-b380726f2908 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.207403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.208525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.209565 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.210148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.210909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.212004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eda910-fde0-42c0-876f-a7a4e51ff594 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.212669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:02.222872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:02.224303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:02.226065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:02.228679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 480/956] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:02.234704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.256426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:02.320446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eda910-fde0-42c0-876f-a7a4e51ff594 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.351445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fab90-d067-4e3a-9c1b-680658f5aeb1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.357180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.357990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.358369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.358735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.359415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.360889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:02.370318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:02.371612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:02.372729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:02.377789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 477/957] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:02.378788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.407022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.408174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.408744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.409296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.410201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:02.410742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.413143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:02.415871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:02.418728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 481/958] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:02.419551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.492307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6f0e9-5687-4a36-8974-d479685af992 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.510587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:02.529637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e5b75-dc85-4e93-a8e5-de70b6fae5b2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.531137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.531845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.532132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.532409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.533041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:02.533348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.534769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:02.540830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 478/959] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:02.541449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.570643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.571267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.571547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.571884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.581895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:02.588112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:02.589046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 482/960] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:02.589983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.650998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:02.655883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ccb74-394d-4e89-a8c0-743c82a6de43 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.693315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.694036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.694324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.694600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.695227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:02.695532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.696896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:02.697792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7ece9-3547-481d-a594-e999bd1e9c7a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.706520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 479/961] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:02.706520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.746913 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.747985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.748275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.748560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.749193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:02.749915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.751893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:02.756766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 483/962] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:02.757560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.767466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:02.833674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b82337-b411-4efb-880d-18d7254fb2c0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.875825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.876435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.876720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.876995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.877740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:02.878073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.879884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:02.890331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 480/963] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:02.895771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:02.903107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94953b-13cd-4244-8846-d683491876a4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:02.932802 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:02.944604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:02.945224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:02.949436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:02.949436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:02.949436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:02.949436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:03.014609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b1a48-ae3a-42c6-a28e-b3a0ed64c1e2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:03.046258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 484/964] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:52:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:52:03.058371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:03.059315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:03.059751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:03.060175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:03.072447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:03.074293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:03.091882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:03.093231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:03.094398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:03.094398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:03.094398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:03.096206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 481/965] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:03.102793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:03.178721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:03.224200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5335c4b-5c87-4a77-b535-4aa351148792 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:03.261117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:03.262051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:03.262487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:03.262940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:03.263622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:03.263932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:03.265358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:03.278833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 485/966] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:03.284118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:03.363547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:03.399403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647117a9-1859-419a-8563-895028cb5bdd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:03.436027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:03.436941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:03.437371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:03.437826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:03.447074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:03.448690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:52:03.461865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:03.463051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 15:52:03.464226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:03.466456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 482/967] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:52:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:03.473805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:03.590973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae4a9-d993-4c25-aa50-f4fbda8956c2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:03.620728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:03.636024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bca3f-b2d2-4d86-b73b-5a0403b81056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:03.636662 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bca3f-b2d2-4d86-b73b-5a0403b81056 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:03.636946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bca3f-b2d2-4d86-b73b-5a0403b81056 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:03.637229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bca3f-b2d2-4d86-b73b-5a0403b81056 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:03.638118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bca3f-b2d2-4d86-b73b-5a0403b81056 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:03.638438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bca3f-b2d2-4d86-b73b-5a0403b81056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:03.639942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bca3f-b2d2-4d86-b73b-5a0403b81056 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:03.661794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 486/968] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Oct 3 15:52:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:03.667283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:03.754578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fbef-00d1-4361-b279-a302c6f26e4b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:03.755103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fbef-00d1-4361-b279-a302c6f26e4b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:03.755103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fbef-00d1-4361-b279-a302c6f26e4b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:03.758093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 487/969] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:03.762098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f27a-a6ba-49b0-b9f9-793bf693a0d0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:03.762380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f27a-a6ba-49b0-b9f9-793bf693a0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:03.762650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063f27a-a6ba-49b0-b9f9-793bf693a0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:03.775000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ccf05-5b95-41c6-bade-219da9d92a27 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:03.783954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3063f27a-a6ba-49b0-b9f9-793bf693a0d0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:03.785212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3063f27a-a6ba-49b0-b9f9-793bf693a0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:03.815814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:03.816586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:03.816995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:03.817342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:03.822168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:03.871497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 488/970] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:03.904427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:03.905941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.011524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 483/971] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:04.017179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f27a-a6ba-49b0-b9f9-793bf693a0d0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.126230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063f27a-a6ba-49b0-b9f9-793bf693a0d0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.137540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:04.154892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.165406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.166132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.166884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.167172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.183185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.184649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.195189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:04.208004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:04.214748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:04.216217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:04.216217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:04.216217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:04.216217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 489/972] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:04.216990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.275094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee9346-f71a-4913-9d7e-9489693fc1e5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.314676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.315917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.316348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.316764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.317858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.319575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.328563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab13d0-cb7c-400f-a0e9-dd9131dc2fdc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.364587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.365967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.366273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.366722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.367460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:04.367828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.369296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.375586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.sql.core [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 15:52:04.375586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 15:52:04.375586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [parameters: {'user_id': '773da4004925477097c22875c9d2e3de', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 15:52:04.375586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81563) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Oct 03 15:52:04.384708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 15:52:04.385605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application yield resource Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise self.value Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application session.commit() Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 15:52:04.387376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.flush() Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application compat.raise_( Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 15:52:04.388344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 15:52:04.389228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 15:52:04.390873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [parameters: {'user_id': '773da4004925477097c22875c9d2e3de', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:04.393024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 03 15:52:04.395168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 03 15:52:04.396832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 03 15:52:04.396832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 03 15:52:04.396832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 15:52:04.396832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 15:52:04.396832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 15:52:04.396832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:04.397332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 490/973] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:04.397332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.404246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 484/974] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Oct 3 15:52:04 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:04.407476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.422832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:04.513334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce25bd-f088-47b7-8f93-7970164629ce None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.518972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:04.526672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779e29-acc4-4ea9-9a17-78716e49fa61 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.555664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.556879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.557584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.558026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.567100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.567940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.568966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.569133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.569480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.569953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.577649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.579547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:52:04.584394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:04.585439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:04.586569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:04.588577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 491/975] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:04.594299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:52:04.602505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:04.603463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 15:52:04.604394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:04.608856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 485/976] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:52:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:04.609699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.703644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:04.724664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b1d3d-f437-43c8-bcfe-a646a1a9380e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.729498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4d7f-573c-49c3-902f-f51567e86df3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.769065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314be8a2-75ed-497a-aaaf-da1d8e7efe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.770186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be8a2-75ed-497a-aaaf-da1d8e7efe93 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.770738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be8a2-75ed-497a-aaaf-da1d8e7efe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.771223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be8a2-75ed-497a-aaaf-da1d8e7efe93 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.772311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be8a2-75ed-497a-aaaf-da1d8e7efe93 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:04.772809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be8a2-75ed-497a-aaaf-da1d8e7efe93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.773258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.773926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.774210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.774490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.775191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:04.775502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.776132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be8a2-75ed-497a-aaaf-da1d8e7efe93 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.776917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.793850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 492/977] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:04.796762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:04.829787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 486/978] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Oct 3 15:52:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:04.921609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d1122-bd0a-4cf9-b5c6-54761f333669 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:04.964997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadd2b3-9bac-496b-9e4a-b695b2c2595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:04.966067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadd2b3-9bac-496b-9e4a-b695b2c2595e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:04.966580 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadd2b3-9bac-496b-9e4a-b695b2c2595e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:04.967066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadd2b3-9bac-496b-9e4a-b695b2c2595e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:04.968070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadd2b3-9bac-496b-9e4a-b695b2c2595e None admin] RBAC: Adding query filter params (role.id=89d893f48d1c4858a86af30d5d6c779f, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=a977434e408a4fac94b0757de67c97cc) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:04.968632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadd2b3-9bac-496b-9e4a-b695b2c2595e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:04.970430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadd2b3-9bac-496b-9e4a-b695b2c2595e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:04.978445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 493/979] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:04 2022] GET /identity/v3/role_assignments?user.id=a977434e408a4fac94b0757de67c97cc&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=89d893f48d1c4858a86af30d5d6c779f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:05.103212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468654e3-763c-461d-8f88-4f223bdbebaa None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:05.103540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468654e3-763c-461d-8f88-4f223bdbebaa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:05.103781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468654e3-763c-461d-8f88-4f223bdbebaa None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:05.105453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 487/980] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:05.111297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76eb75-4fb8-41c2-8f77-d6096ae50e40 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:05.111613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76eb75-4fb8-41c2-8f77-d6096ae50e40 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:05.111867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76eb75-4fb8-41c2-8f77-d6096ae50e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:05.126572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:05.134915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cd76eb75-4fb8-41c2-8f77-d6096ae50e40 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:05.136558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cd76eb75-4fb8-41c2-8f77-d6096ae50e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:05.213082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 494/981] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:05.432530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4c377-80d3-48e5-a98f-5e72aadd96d8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:05.432909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4c377-80d3-48e5-a98f-5e72aadd96d8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:05.433116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4c377-80d3-48e5-a98f-5e72aadd96d8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:05.434555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 488/982] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:05.439966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e253-27b8-4b50-824c-896a54e3e828 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:05.440256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e253-27b8-4b50-824c-896a54e3e828 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:05.440525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2e253-27b8-4b50-824c-896a54e3e828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:05.462097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b8a2e253-27b8-4b50-824c-896a54e3e828 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:05.463505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b8a2e253-27b8-4b50-824c-896a54e3e828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:05.492942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4c377-80d3-48e5-a98f-5e72aadd96d8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:05.508967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:05.534064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 495/983] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:05.602094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4c377-80d3-48e5-a98f-5e72aadd96d8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:05.637011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:05.637616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:05.637931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:05.638202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:05.638870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:05.640228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:05.691610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 489/984] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:52:05 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 15:52:05.845490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2e253-27b8-4b50-824c-896a54e3e828 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:05.920982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:05.960359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2e253-27b8-4b50-824c-896a54e3e828 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:06.000924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:06.001561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:06.001869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:06.002150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:06.002733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:06.004091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:06.013034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:06.014238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:06.015601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 496/985] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:52:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:06.019997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:06.092602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:06.122772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c280a-fa34-4a6f-af83-d40734b3546b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:06.159743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:06.160423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:06.160712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:06.160988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:06.161619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:06.162547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:06.164339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:06.174040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 490/986] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:52:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:06.175335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:06.278541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d030d-cbf1-4109-8c2c-191fd91d70f9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:06.305850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:06.315015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:06.315627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:06.315909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:06.316778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:06.316778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:06.317150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:06.318578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:06.328231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 497/987] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:52:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:06.329253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:06.430606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35936-f69d-4918-b612-32dc4094f578 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:06.465336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34474b16-4035-4523-a933-a9855c78f6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:06.465972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474b16-4035-4523-a933-a9855c78f6dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:06.466259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474b16-4035-4523-a933-a9855c78f6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:06.466538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474b16-4035-4523-a933-a9855c78f6dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:06.467244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474b16-4035-4523-a933-a9855c78f6dc None admin] RBAC: Adding query filter params (interface=admin, service_id=12daba708d7e4824b571836c14a7155f, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:06.467558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474b16-4035-4523-a933-a9855c78f6dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:06.468920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474b16-4035-4523-a933-a9855c78f6dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:06.471286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:06.480114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 491/988] 10.222.0.26 () {56 vars in 1249 bytes} [Mon Oct 3 15:52:06 2022] GET /identity/v3/endpoints?service_id=12daba708d7e4824b571836c14a7155f&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:06.481479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:06.581083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211867-8e16-4f69-a493-6e7f89a7b2b1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:06.617768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084a0af-8f6a-4505-85b8-bdf4a2184f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:06.618413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a0af-8f6a-4505-85b8-bdf4a2184f30 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:06.618695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a0af-8f6a-4505-85b8-bdf4a2184f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:06.618970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084a0af-8f6a-4505-85b8-bdf4a2184f30 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:06.619577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084a0af-8f6a-4505-85b8-bdf4a2184f30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:06.620939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084a0af-8f6a-4505-85b8-bdf4a2184f30 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:06.633272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 498/989] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:52:06 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 15:52:07.229883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d370f1-dc6e-4a7f-ad5c-798c07a2e170 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:07.230408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d370f1-dc6e-4a7f-ad5c-798c07a2e170 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:07.230408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d370f1-dc6e-4a7f-ad5c-798c07a2e170 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:07.231912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 492/990] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:07.236852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a196-2eaa-46b1-85d4-aff64004b2d2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:07.237251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a196-2eaa-46b1-85d4-aff64004b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:07.237417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05a196-2eaa-46b1-85d4-aff64004b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:07.255943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3e05a196-2eaa-46b1-85d4-aff64004b2d2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:07.257268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3e05a196-2eaa-46b1-85d4-aff64004b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:07.308094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:07.325999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 499/991] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:07.591691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d370f1-dc6e-4a7f-ad5c-798c07a2e170 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:07.694051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d370f1-dc6e-4a7f-ad5c-798c07a2e170 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:07.736703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a499f-a995-40d9-a4d9-f231c72840ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:07.737340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a499f-a995-40d9-a4d9-f231c72840ee None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:07.737621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a499f-a995-40d9-a4d9-f231c72840ee None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:07.738024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a499f-a995-40d9-a4d9-f231c72840ee None admin] PATH_INFO: `/v3/services/image` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:07.738616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a499f-a995-40d9-a4d9-f231c72840ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:07.740586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a499f-a995-40d9-a4d9-f231c72840ee None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-232a499f-a995-40d9-a4d9-f231c72840ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:07.749846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:07.750818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:07.751682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:07.753096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 493/992] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Oct 3 15:52:07 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:07.757778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05a196-2eaa-46b1-85d4-aff64004b2d2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:07.866621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05a196-2eaa-46b1-85d4-aff64004b2d2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:07.882358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223f92-e682-42ec-97e2-2992db7c1dd5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:07.882771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223f92-e682-42ec-97e2-2992db7c1dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:07.883055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24223f92-e682-42ec-97e2-2992db7c1dd5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:07.885019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 494/993] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:07.890176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6dfe-07d3-4386-8b48-110febcc1a9b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:07.890469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6dfe-07d3-4386-8b48-110febcc1a9b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:07.890741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c6dfe-07d3-4386-8b48-110febcc1a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:07.901647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:07.902313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:07.902601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:07.902880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:07.903518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] RBAC: Adding query filter params (name=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:07.903829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:07.905214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:07.910015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e14c6dfe-07d3-4386-8b48-110febcc1a9b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:07.915384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 500/994] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:07.915515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e14c6dfe-07d3-4386-8b48-110febcc1a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:07.916373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:07.970036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:07.975818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:07.984250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 495/995] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:08.023189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796c4d8-1a0a-4f0e-a6b1-f101b20b3b28 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:08.058124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:08.058733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:08.059017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:08.059287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:08.059912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:08.060223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:08.061595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:08.069986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 501/996] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:08.254110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6dfe-07d3-4386-8b48-110febcc1a9b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:08.353877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c6dfe-07d3-4386-8b48-110febcc1a9b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:08.387044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:08.387681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:08.388030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:08.388307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:08.388884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:08.390272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:08.399447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:08.400477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:08.401325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:08.405392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 496/997] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:08.406834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:08.514198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2badb33-a240-4cda-9dd5-1de56cc1c8e9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:08.528180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:08.550155 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:08.550767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:08.551048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:08.551324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:08.551950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:08.552254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:08.554723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:08.561133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 502/998] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:52:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:08.565499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:08.625806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:08.668026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d65cf-e3da-46b5-b536-741212bff6f6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:08.701493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6885b49-e60f-497a-aba7-9731b80a2f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:08.702166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6885b49-e60f-497a-aba7-9731b80a2f1e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:08.702445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6885b49-e60f-497a-aba7-9731b80a2f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:08.702714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6885b49-e60f-497a-aba7-9731b80a2f1e None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:08.703355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6885b49-e60f-497a-aba7-9731b80a2f1e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:08.703657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6885b49-e60f-497a-aba7-9731b80a2f1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:08.705067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6885b49-e60f-497a-aba7-9731b80a2f1e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:08.711273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 497/999] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:52:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:08.717523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:08.833136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaab98-233d-4869-97a7-2f9344755e07 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:08.845593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dd32-6a2d-4080-a151-547db9bc3c7f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:08.845915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dd32-6a2d-4080-a151-547db9bc3c7f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:08.846201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92dd32-6a2d-4080-a151-547db9bc3c7f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:08.847888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 498/1000] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:08.854023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a3b4-b107-421d-9b6e-39fe583624e7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:08.854310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a3b4-b107-421d-9b6e-39fe583624e7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:08.854592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69a3b4-b107-421d-9b6e-39fe583624e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:08.872646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:08.873505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:08.873716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3d69a3b4-b107-421d-9b6e-39fe583624e7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:08.874133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:08.874576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:08.874933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3d69a3b4-b107-421d-9b6e-39fe583624e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:08.875587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] RBAC: Adding query filter params (interface=public, service_id=797c359cf09c4dd7860b55c3c3399d57, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:08.876059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:08.877577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:08.883355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 503/1001] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:52:08 2022] GET /identity/v3/endpoints?service_id=797c359cf09c4dd7860b55c3c3399d57&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:08.888744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:08.934917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:08.950292 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 499/1002] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:09.002639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c620711-bbdf-4650-b35d-09c9305614ae None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:09.036855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:09.037629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:09.037947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:09.038223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:09.038821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:09.040187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:09.046658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 504/1003] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:52:08 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 15:52:09.221162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69a3b4-b107-421d-9b6e-39fe583624e7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:09.274982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:09.322195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69a3b4-b107-421d-9b6e-39fe583624e7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:09.356064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:09.356698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:09.356976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:09.357245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:09.357850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:09.359241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:09.368147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:09.369186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:09.370065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 500/1004] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Oct 3 15:52:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:09.375431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:09.482531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fc776-cdbb-4528-a673-46072e162e7c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:09.484816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:09.519038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:09.519655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:09.519940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:09.520219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:09.520851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:09.521190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:09.522640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:09.530397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 505/1005] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:52:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:09.533128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:09.634825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada54fc2-e334-4c50-8eef-558668727676 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:09.653041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:09.671630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4188-f93d-4dd6-b41b-26b585a64ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:09.672244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4188-f93d-4dd6-b41b-26b585a64ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:09.672533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4188-f93d-4dd6-b41b-26b585a64ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:09.672802 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4188-f93d-4dd6-b41b-26b585a64ba3 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:09.673429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4188-f93d-4dd6-b41b-26b585a64ba3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:09.673732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4188-f93d-4dd6-b41b-26b585a64ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:09.675121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4188-f93d-4dd6-b41b-26b585a64ba3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:09.680343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 501/1006] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Oct 3 15:52:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:09.687254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:09.799971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9a822-d410-4c88-aca8-6b7c3b36cbd4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:09.835179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9699a-dce0-4ac8-949b-f12f6e8cf69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:09.835855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9699a-dce0-4ac8-949b-f12f6e8cf69b None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:09.836143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9699a-dce0-4ac8-949b-f12f6e8cf69b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:09.836422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9699a-dce0-4ac8-949b-f12f6e8cf69b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:09.837098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9699a-dce0-4ac8-949b-f12f6e8cf69b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:09.838503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9699a-dce0-4ac8-949b-f12f6e8cf69b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:09.914157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 506/1007] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:52:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 15:52:10.330152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9ab17-6fc7-4d6d-8225-854b066c9b10 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:10.330727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9ab17-6fc7-4d6d-8225-854b066c9b10 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:10.330727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9ab17-6fc7-4d6d-8225-854b066c9b10 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:10.332189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 502/1008] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:10.338271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5ab5-6589-4f7f-87ae-5fd949bb7ad8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:10.338569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5ab5-6589-4f7f-87ae-5fd949bb7ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:10.338854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5ab5-6589-4f7f-87ae-5fd949bb7ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:10.357942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-80dd5ab5-6589-4f7f-87ae-5fd949bb7ad8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:10.359130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80dd5ab5-6589-4f7f-87ae-5fd949bb7ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:10.383741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:10.435791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 507/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:10 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:10.702006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9ab17-6fc7-4d6d-8225-854b066c9b10 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:10.809012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9ab17-6fc7-4d6d-8225-854b066c9b10 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:10.845254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b2016-cb9f-49d6-b881-9250b90a4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:10.846290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2016-cb9f-49d6-b881-9250b90a4a12 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:10.846789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2016-cb9f-49d6-b881-9250b90a4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:10.847288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2016-cb9f-49d6-b881-9250b90a4a12 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:10.848134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b2016-cb9f-49d6-b881-9250b90a4a12 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:10.849733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b2016-cb9f-49d6-b881-9250b90a4a12 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:10.960334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 503/1010] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:52:10 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:52:11.248833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ddb04-dfa6-42de-8caa-35c7ebaf1b59 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:11.249360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ddb04-dfa6-42de-8caa-35c7ebaf1b59 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:11.249360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ddb04-dfa6-42de-8caa-35c7ebaf1b59 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:11.250823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 508/1011] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:11.256437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8722db-93d3-4f81-9655-79d56965dab8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:11.256720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8722db-93d3-4f81-9655-79d56965dab8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:11.256998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8722db-93d3-4f81-9655-79d56965dab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:11.275364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6e8722db-93d3-4f81-9655-79d56965dab8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:11.276539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6e8722db-93d3-4f81-9655-79d56965dab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:11.310792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:11.352078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 504/1012] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:11 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:11.627718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ddb04-dfa6-42de-8caa-35c7ebaf1b59 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:11.742870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ddb04-dfa6-42de-8caa-35c7ebaf1b59 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:11.779279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:11.779907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:11.780188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:11.780466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:11.781044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:11.782450 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:11.792353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:11.793353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:11.799177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 509/1013] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:11.800026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8722db-93d3-4f81-9655-79d56965dab8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:11.906308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8722db-93d3-4f81-9655-79d56965dab8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:11.940963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5824595-ac15-4f22-a8a8-225a7f33f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:11.941572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824595-ac15-4f22-a8a8-225a7f33f260 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:11.941881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824595-ac15-4f22-a8a8-225a7f33f260 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:11.942154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5824595-ac15-4f22-a8a8-225a7f33f260 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:11.942774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5824595-ac15-4f22-a8a8-225a7f33f260 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:11.943635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5824595-ac15-4f22-a8a8-225a7f33f260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:11.945083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5824595-ac15-4f22-a8a8-225a7f33f260 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:11.954525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 505/1014] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:52:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:11.955694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:11.979506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:12.066686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef731-8f28-46d5-a13d-2e5214e640e5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:12.093452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328d37-049f-4de9-9cd1-7f274dbf02c8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:12.093746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328d37-049f-4de9-9cd1-7f274dbf02c8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:12.094054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a328d37-049f-4de9-9cd1-7f274dbf02c8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:12.095384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 506/1015] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:12.100808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827c330-457c-4e19-b038-9f1e93f64916 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:12.101090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827c330-457c-4e19-b038-9f1e93f64916 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:12.101368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827c330-457c-4e19-b038-9f1e93f64916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:12.105664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:12.106475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:12.106903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:12.107346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:12.108034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:12.108349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:12.109740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:12.119672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 510/1016] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Oct 3 15:52:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:12.120658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:12.120785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1827c330-457c-4e19-b038-9f1e93f64916 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:12.121924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1827c330-457c-4e19-b038-9f1e93f64916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:12.149439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:12.194573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 507/1017] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:12 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:12.209684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:12.228256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b0c7-6452-4959-9236-242b77f5e842 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:12.263207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:12.263822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:12.264075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:12.264345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:12.265000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:12.266390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:12.359404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 511/1018] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:52:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:52:12.473889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827c330-457c-4e19-b038-9f1e93f64916 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:12.577997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827c330-457c-4e19-b038-9f1e93f64916 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:12.618849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041139b8-cce7-4781-8ca0-668a973d2d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:12.619486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041139b8-cce7-4781-8ca0-668a973d2d4c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:12.619764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041139b8-cce7-4781-8ca0-668a973d2d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:12.620042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041139b8-cce7-4781-8ca0-668a973d2d4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:12.621153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041139b8-cce7-4781-8ca0-668a973d2d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:12.622586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041139b8-cce7-4781-8ca0-668a973d2d4c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:12.624121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 508/1019] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:12.630903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:12.744921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d445c-508b-48d4-bbb6-3aac28b2a59d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:12.780262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62888-62db-4377-81b1-1c6c8bdf47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:12.780877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62888-62db-4377-81b1-1c6c8bdf47ae None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:12.781160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62888-62db-4377-81b1-1c6c8bdf47ae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:12.781435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62888-62db-4377-81b1-1c6c8bdf47ae None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:12.782115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62888-62db-4377-81b1-1c6c8bdf47ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:12.783640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62888-62db-4377-81b1-1c6c8bdf47ae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:12.794669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:12.912094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 512/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:52:12 2022] POST /identity/v3/projects => generated 311 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:52:13.154867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afae82-113b-46eb-b3c1-440b22086dd5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:13.155067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afae82-113b-46eb-b3c1-440b22086dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:13.155286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afae82-113b-46eb-b3c1-440b22086dd5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:13.156746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 509/1021] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:13.162468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995240-73d6-4e5f-9a06-5fd8e98f9dd4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:13.162846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995240-73d6-4e5f-9a06-5fd8e98f9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:13.163301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21995240-73d6-4e5f-9a06-5fd8e98f9dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:13.182657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-21995240-73d6-4e5f-9a06-5fd8e98f9dd4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:13.183840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-21995240-73d6-4e5f-9a06-5fd8e98f9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:13.251786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 513/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:13.521830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afae82-113b-46eb-b3c1-440b22086dd5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:13.547257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:13.626210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afae82-113b-46eb-b3c1-440b22086dd5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:13.660553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:13.661183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:13.661460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:13.662333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] PATH_INFO: `/v3/services/image` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:13.662914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:13.664277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:13.673269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:13.674464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:13.675466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:13.676724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 510/1023] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Oct 3 15:52:13 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:13.680320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21995240-73d6-4e5f-9a06-5fd8e98f9dd4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:13.794261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21995240-73d6-4e5f-9a06-5fd8e98f9dd4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:13.814558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:13.829703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:13.830368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:13.830653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:13.830936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:13.831589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] RBAC: Adding query filter params (name=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:13.831899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:13.833329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:13.844643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 514/1024] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:13.845989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:13.939545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:13.952066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8612ba-de95-4735-9072-b3216c897b1e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:13.985922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:13.986523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:13.986801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:13.987071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:13.987686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] RBAC: Adding query filter params (type=image) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:13.987987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:13.989327 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:13.996439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 511/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:13.999999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:14.104380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471af66-60ab-421f-a864-ab6e5e43c4bf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:14.138706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a83c1-5034-4a60-abea-86796434cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:14.139320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a83c1-5034-4a60-abea-86796434cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:14.139603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a83c1-5034-4a60-abea-86796434cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:14.139879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a83c1-5034-4a60-abea-86796434cbd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:14.140582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a83c1-5034-4a60-abea-86796434cbd0 None admin] RBAC: Adding query filter params (interface=public, service_id=96e7491baef14404b2e28e7c12cf3c73, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:14.140893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a83c1-5034-4a60-abea-86796434cbd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:14.142309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a83c1-5034-4a60-abea-86796434cbd0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:14.152929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 515/1026] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:52:13 2022] GET /identity/v3/endpoints?service_id=96e7491baef14404b2e28e7c12cf3c73&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:14.154357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:14.256983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8e6a2-d8cd-42e4-8aa4-c6fc36ad1894 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:14.292083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717dbb4-bf47-430c-b827-1b6ed7eb32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:14.292684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717dbb4-bf47-430c-b827-1b6ed7eb32e6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:14.292962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717dbb4-bf47-430c-b827-1b6ed7eb32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:14.293235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717dbb4-bf47-430c-b827-1b6ed7eb32e6 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:14.293856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717dbb4-bf47-430c-b827-1b6ed7eb32e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:14.295226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717dbb4-bf47-430c-b827-1b6ed7eb32e6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:14.305801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 512/1027] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:52:14 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 15:52:14.691805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53da6dd-0eb3-4c25-bc54-6495c2e0a41a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:14.692354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53da6dd-0eb3-4c25-bc54-6495c2e0a41a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:14.692354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53da6dd-0eb3-4c25-bc54-6495c2e0a41a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:14.694504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 516/1028] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:14.699627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a37ca-87f0-4e4d-906f-2c7b92cdf856 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:14.700023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a37ca-87f0-4e4d-906f-2c7b92cdf856 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:14.700184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a37ca-87f0-4e4d-906f-2c7b92cdf856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:14.720071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f27a37ca-87f0-4e4d-906f-2c7b92cdf856 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:14.721263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f27a37ca-87f0-4e4d-906f-2c7b92cdf856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:14.735365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:14.792924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 513/1029] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:15.063973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53da6dd-0eb3-4c25-bc54-6495c2e0a41a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:15.117610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.119449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290fab-c921-44ff-a3de-0355cb8e5ebf None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.119735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290fab-c921-44ff-a3de-0355cb8e5ebf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.120006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86290fab-c921-44ff-a3de-0355cb8e5ebf None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.121476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 514/1030] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:15.126510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7881fd-18ca-4aa0-8390-a1cd689d1d0b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.126839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7881fd-18ca-4aa0-8390-a1cd689d1d0b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.127097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7881fd-18ca-4aa0-8390-a1cd689d1d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.145510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ef7881fd-18ca-4aa0-8390-a1cd689d1d0b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:15.146811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ef7881fd-18ca-4aa0-8390-a1cd689d1d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:15.173066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53da6dd-0eb3-4c25-bc54-6495c2e0a41a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:15.220867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 515/1031] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:15.225824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:15.226770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.227237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.227682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.238414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:15.243493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:15.244428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:15.245274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:15.247555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 517/1032] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Oct 3 15:52:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:15.253101 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7881fd-18ca-4aa0-8390-a1cd689d1d0b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:15.333170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.357091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7881fd-18ca-4aa0-8390-a1cd689d1d0b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:15.392765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:15.393690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.394317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.394806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.395670 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:15.396854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:15.398445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:15.407180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 516/1033] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Oct 3 15:52:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:15.412818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:15.495589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:15.518783 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4c5cf-dcb3-47e6-a4e7-1d73f0b5c30c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:15.529838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.558643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:15.559602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.560161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.560462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.572281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:15.573734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:15.591187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:15.592162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:15.593053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:15.593053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:15.593053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:15.593053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 518/1034] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:15.598150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:15.606397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f824f-4159-42d2-929f-0a98d6a2e42e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:15.642734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:15.643371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.643658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.643932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.645037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:15.647037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:15.648750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 517/1035] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:15.654288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:15.663976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.710222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1caf3b-3dfa-4f3c-8166-d473cfd2a7a3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:15.750500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:15.751106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.751381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.751650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.752285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:15.752586 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:15.754184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:15.766221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aa9c7-39d6-4e52-93df-2f5545bf28b9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:15.771701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 519/1036] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:15.773985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:15.797790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:15.806043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:15.813230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.813230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.813230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.813230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:15.813230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:15.882285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005c4e-8880-497a-bb19-2b00a8228c37 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:15.916855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:15.917482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:15.917863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:15.918085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:15.925035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:15.926600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:15.936888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 518/1037] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:52:15 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:52:15.939184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:15.947480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:15.948534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 520/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:52:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:15.951475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:16.024675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:16.070447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6697f1-f33c-4304-8bd2-0c469e5a24bd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:16.109237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:16.109885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.110171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.110446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.111458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:16.111458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:16.112905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:16.132680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 519/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:52:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:16.138203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:16.226843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:16.245541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1e8f3-60f9-4a71-8a4c-37119b9953a8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:16.281235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1a3b0-d921-48e0-83b5-880849b86a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:16.281870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a3b0-d921-48e0-83b5-880849b86a12 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.282152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a3b0-d921-48e0-83b5-880849b86a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.282425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1a3b0-d921-48e0-83b5-880849b86a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.352142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1a3b0-d921-48e0-83b5-880849b86a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:16.353599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1a3b0-d921-48e0-83b5-880849b86a12 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:16.439356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:16.460706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 521/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 15:52:16.466788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:16.489750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84644a-dad1-45bd-bc28-923f1d30a0b3 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.490233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84644a-dad1-45bd-bc28-923f1d30a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.490516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84644a-dad1-45bd-bc28-923f1d30a0b3 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.491980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 522/1041] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:16.496770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065daf3-17ac-4c89-94c6-301e12fc2b8f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.497059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065daf3-17ac-4c89-94c6-301e12fc2b8f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.497337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065daf3-17ac-4c89-94c6-301e12fc2b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.516530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9065daf3-17ac-4c89-94c6-301e12fc2b8f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:16.517714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9065daf3-17ac-4c89-94c6-301e12fc2b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:16.575345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beb51b-afab-4d8f-8444-d602c662c32f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:16.587392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 523/1042] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:16.602087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:16.617346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:16.618096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.618439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.618771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.629421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:16.631766 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:16.646318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:16.647541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:16.648587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:16.648587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:16.648587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:16.649425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 520/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:16.654491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065daf3-17ac-4c89-94c6-301e12fc2b8f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:16.766075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065daf3-17ac-4c89-94c6-301e12fc2b8f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:16.777562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:16.800952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:16.801555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.801867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.802210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.803440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:16.803740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:16.805143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:16.821252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 524/1044] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:16.822614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:16.856506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:16.938909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270565d-1f88-4813-b35c-5b3c50108bc2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:16.962217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e69e95-3ffc-4507-bcac-980f126c5a10 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:16.976782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:16.977417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.977699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.978016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.984677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:16.986084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:16.997175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:16.997827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:16.998114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:16.998389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:16.998966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:52:16.999061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:16.999917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:17.000835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:17.001273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:17.004897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 521/1045] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:17.006455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:17.010669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:17.011675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 15:52:17.012563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:17.016713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 525/1046] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Oct 3 15:52:16 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:17.017538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:17.040654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:17.052870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:17.120455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de028c-8b84-4b77-a923-3f8d520b0fe1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:17.120651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91372a9-ac89-4302-b58a-f31f6d0928b3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:17.157455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:17.158100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:17.158383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:17.158587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:17.158705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:17.159190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:17.159360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:17.159461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:17.159644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:17.159738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:17.160319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] RBAC: Adding query filter params (name=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:17.160618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:17.161074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:17.162846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:17.169808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 526/1047] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:17.173573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:17.175191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 522/1048] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:52:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:17.181944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:17.292068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:17.293695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:17.296623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8dc2-be14-4914-ad66-30d6a0a176fc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:17.303062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8ba8d-dfa8-4d53-89c2-71fab7d3b9cc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:17.332874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:17.334277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:17.334563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:17.334843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:17.335472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] RBAC: Adding query filter params (type=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:17.335776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:17.337145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:17.341892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 527/1049] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:17.347501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:17.347631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a1112-2fc5-49c4-a80e-0689239a83dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:17.348145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a1112-2fc5-49c4-a80e-0689239a83dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:17.348440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a1112-2fc5-49c4-a80e-0689239a83dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:17.348696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a1112-2fc5-49c4-a80e-0689239a83dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:17.350018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a1112-2fc5-49c4-a80e-0689239a83dc None admin] RBAC: Adding query filter params (role.id=89d893f48d1c4858a86af30d5d6c779f, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=5550726a2c5e4aff9c16f509a3d1bb0a) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:17.350332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a1112-2fc5-49c4-a80e-0689239a83dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:17.351768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a1112-2fc5-49c4-a80e-0689239a83dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:17.357597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 523/1050] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:17 2022] GET /identity/v3/role_assignments?user.id=5550726a2c5e4aff9c16f509a3d1bb0a&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=89d893f48d1c4858a86af30d5d6c779f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:17.461125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb54dc-695c-47f9-a00a-d9eac6d3ff0b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:17.497639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280ea6f-5584-49a2-a6b2-f5595a25bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:17.498278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280ea6f-5584-49a2-a6b2-f5595a25bedd None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:17.498556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280ea6f-5584-49a2-a6b2-f5595a25bedd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:17.498824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280ea6f-5584-49a2-a6b2-f5595a25bedd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:17.499492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280ea6f-5584-49a2-a6b2-f5595a25bedd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:17.500870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280ea6f-5584-49a2-a6b2-f5595a25bedd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:17.616826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 528/1051] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:52:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:52:18.267752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4e831-cf9f-4201-bb83-b83cc5f24c1b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:18.268274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4e831-cf9f-4201-bb83-b83cc5f24c1b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:18.268354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4e831-cf9f-4201-bb83-b83cc5f24c1b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:18.269785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 524/1052] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:18.275731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41033d-a595-4f14-9747-ff7d54f37b08 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:18.275731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41033d-a595-4f14-9747-ff7d54f37b08 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:18.276261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41033d-a595-4f14-9747-ff7d54f37b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:18.294715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2e41033d-a595-4f14-9747-ff7d54f37b08 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:18.295879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2e41033d-a595-4f14-9747-ff7d54f37b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:18.309934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:18.374041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 529/1053] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:18.641675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4e831-cf9f-4201-bb83-b83cc5f24c1b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:18.749742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4e831-cf9f-4201-bb83-b83cc5f24c1b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:18.783723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:18.784342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:18.784622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:18.784891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:18.795384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:18.800103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:18.801031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:18.801909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:18.803370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 525/1054] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:18.807367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41033d-a595-4f14-9747-ff7d54f37b08 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:18.904646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41033d-a595-4f14-9747-ff7d54f37b08 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:18.938510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:18.939118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:18.939398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:18.939681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:18.940319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:18.940617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:18.942003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:18.950504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 530/1055] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:18.956199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:18.975480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:19.056414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4db1d8-f121-479d-b3f4-dcb83f45e824 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:19.089937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:19.090502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.090780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.091050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] PATH_INFO: `/v3/users/0a33fb46c5674f59bd0588eb629fb132` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.105519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] RBAC: Authorizing `identity:get_user(user_id=0a33fb46c5674f59bd0588eb629fb132)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:19.107003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:19.108859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 526/1056] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:18 2022] GET /identity/v3/users/0a33fb46c5674f59bd0588eb629fb132 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:19.114338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:19.124551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:19.220010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de61caf-3124-4a08-8f1c-3a800aeff6bb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:19.259616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1aa23-1e3f-4528-9beb-b410c4808af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:19.260221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1aa23-1e3f-4528-9beb-b410c4808af8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.260499 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1aa23-1e3f-4528-9beb-b410c4808af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.260769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1aa23-1e3f-4528-9beb-b410c4808af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.328130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1aa23-1e3f-4528-9beb-b410c4808af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:19.329572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1aa23-1e3f-4528-9beb-b410c4808af8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:19.337888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:19.433017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 531/1057] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:19.438962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:19.515710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:19.542085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9581b-cf18-4a33-9676-11a86dc43239 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:19.552307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f92c-888b-4f0f-aa9a-661c3f56428a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.552581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f92c-888b-4f0f-aa9a-661c3f56428a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.552861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f92c-888b-4f0f-aa9a-661c3f56428a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.554233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 532/1058] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:19.559148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68c88-56af-4d42-b5e4-c982778898c4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.559427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68c88-56af-4d42-b5e4-c982778898c4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.559701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b68c88-56af-4d42-b5e4-c982778898c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.577606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-37b68c88-56af-4d42-b5e4-c982778898c4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:19.578798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-37b68c88-56af-4d42-b5e4-c982778898c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:19.579471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:19.580106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.580391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.580784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.582018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7229711a7348429703b6661517dc8d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:19.584090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:19.585848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 527/1059] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:19 2022] GET /identity/v3/projects/7a7229711a7348429703b6661517dc8d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:19.593114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:19.658018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 533/1060] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:19.710593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760c79-b85d-4ce0-b00d-064da67b3df2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:19.751570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4cddb-a297-46a9-83e9-1d7aa38215b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:19.752172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4cddb-a297-46a9-83e9-1d7aa38215b9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.752455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4cddb-a297-46a9-83e9-1d7aa38215b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.752721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4cddb-a297-46a9-83e9-1d7aa38215b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.753435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4cddb-a297-46a9-83e9-1d7aa38215b9 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=7a7229711a7348429703b6661517dc8d, user.id=0a33fb46c5674f59bd0588eb629fb132) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:19.753741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4cddb-a297-46a9-83e9-1d7aa38215b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:19.755254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4cddb-a297-46a9-83e9-1d7aa38215b9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:19.770192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 528/1061] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:19 2022] GET /identity/v3/role_assignments?user.id=0a33fb46c5674f59bd0588eb629fb132&scope.project.id=7a7229711a7348429703b6661517dc8d&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:19.781643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38d73-9b8d-48d4-a4eb-bc94f22ee1ac None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.782015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38d73-9b8d-48d4-a4eb-bc94f22ee1ac None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.782236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb38d73-9b8d-48d4-a4eb-bc94f22ee1ac None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.783777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 534/1062] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:19.790323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc5b8-36c3-4c3b-9c99-1530515560be None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:19.790655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc5b8-36c3-4c3b-9c99-1530515560be None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:19.790896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc5b8-36c3-4c3b-9c99-1530515560be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:19.804907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:19.810791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6f2cc5b8-36c3-4c3b-9c99-1530515560be None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:19.811990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6f2cc5b8-36c3-4c3b-9c99-1530515560be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:19.884398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 529/1063] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:19.930694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb38d73-9b8d-48d4-a4eb-bc94f22ee1ac None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:19.970454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:20.037311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb38d73-9b8d-48d4-a4eb-bc94f22ee1ac None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.072001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.072632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.072911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.073182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.085071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:20.089954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:20.090946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:20.091866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:20.096169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 535/1064] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Oct 3 15:52:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:20.097005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc5b8-36c3-4c3b-9c99-1530515560be None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.157284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.200071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc5b8-36c3-4c3b-9c99-1530515560be None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.241652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.242568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.242856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.243134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.243803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:20.244107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.245460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.248937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:20.256418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 530/1065] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:20.261943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.264029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:20.269882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c8f2-f840-4c6c-97dd-1aef46d63256 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.304919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.305448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.305724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.306050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.368255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32fa9-158b-4369-a1a1-93460104a4ac None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.374850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.376314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.405007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.405749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.406155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.406444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.418010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.419591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:20.435885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:20.437023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:20.438169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:20.438169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:20.438169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:20.438169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 531/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:20.443574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.472459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:20.479282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 536/1067] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 15:52:20.486727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.499100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:20.553291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c34d5-1047-4454-83e9-19f7ed8d36dc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.587659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.588186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.588460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.588738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.589369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:20.589666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.591054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.591172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee07a9-2790-41de-b433-99c5069629a3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.604058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 532/1068] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:20.609215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.634371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.634974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.635255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.635585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.646784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.648275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:20.668152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:20.669169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:20.674861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:20.674861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:20.674861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:20.674861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 537/1069] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:20.677899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.722599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85a836-1cb4-4051-990f-8a7d994dc102 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.733720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:20.735006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:20.760872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.761503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.761835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.762164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.769274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.770800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:52:20.782714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:20.783697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:52:20.784677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:20.785258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e903-6716-4b1f-90e5-9fb8199d73bd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.789417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 533/1070] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:20.790293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:20.823162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.823776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.824059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.824388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.825031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:20.825390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.826791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.839168 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 538/1071] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:20.902668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120328-62db-49fc-be1f-957dfc1be3ff None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:20.940111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:20.940738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:20.941024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:20.941305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:20.942079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:20.942391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:20.944095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:20.968899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 534/1072] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:20.970239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:21.081200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc1184-3303-4a55-9e5a-3c9883aa4f9a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:21.091570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:21.117454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:21.118168 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:21.118883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:21.119535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:21.130658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:21.132234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:21.148181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:21.149181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:21.150181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:21.150181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:21.150181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:21.150181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 539/1073] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:21.155287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:21.186327 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:21.257118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f583d1b-9e7c-49cf-8079-ec14c7a6cde3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:21.290250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:21.290854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:21.291143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:21.291420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:21.292066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:21.292373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:21.293738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:21.311496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 535/1074] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:21.312664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:21.412588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b6604-3ad3-4d32-916d-1b5c06059d38 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:21.445732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:21.446384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:21.446667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:21.446942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:21.453566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:21.455038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:52:21.466806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:21.467873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:21.468786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 540/1075] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:21.473666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:21.559840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:21.571949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29031e56-e937-438b-804b-9d03ceb68bbb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:21.606190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27feb6-7725-47ac-ac63-e556d6db3912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:21.606805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27feb6-7725-47ac-ac63-e556d6db3912 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:21.607084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27feb6-7725-47ac-ac63-e556d6db3912 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:21.607355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27feb6-7725-47ac-ac63-e556d6db3912 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:21.608039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27feb6-7725-47ac-ac63-e556d6db3912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:21.608345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27feb6-7725-47ac-ac63-e556d6db3912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:21.609791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27feb6-7725-47ac-ac63-e556d6db3912 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:21.621862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 536/1076] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:21.627596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:21.655195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:21.733245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c52d0-bebf-473c-a729-61b4bbf3566d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:21.766093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ba7f7-d2ba-40ed-91b9-798dae00ff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:21.766742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba7f7-d2ba-40ed-91b9-798dae00ff91 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:21.767021 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba7f7-d2ba-40ed-91b9-798dae00ff91 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:21.767294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba7f7-d2ba-40ed-91b9-798dae00ff91 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/5550726a2c5e4aff9c16f509a3d1bb0a/roles/89d893f48d1c4858a86af30d5d6c779f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:21.769375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ba7f7-d2ba-40ed-91b9-798dae00ff91 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=5550726a2c5e4aff9c16f509a3d1bb0a, role_id=89d893f48d1c4858a86af30d5d6c779f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:21.771465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ba7f7-d2ba-40ed-91b9-798dae00ff91 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:21.844031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 541/1077] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:52:21 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/5550726a2c5e4aff9c16f509a3d1bb0a/roles/89d893f48d1c4858a86af30d5d6c779f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:52:21.999424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed40ab-e6cb-47eb-bb31-71bc0ce3ea5c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:21.999627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed40ab-e6cb-47eb-bb31-71bc0ce3ea5c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:21.999893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed40ab-e6cb-47eb-bb31-71bc0ce3ea5c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:22.001396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 537/1078] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:22.007030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17b7a-3651-40f1-9d40-d4a07a542afe None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:22.007317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17b7a-3651-40f1-9d40-d4a07a542afe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:22.007595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b17b7a-3651-40f1-9d40-d4a07a542afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:22.026831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-91b17b7a-3651-40f1-9d40-d4a07a542afe None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:22.028009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-91b17b7a-3651-40f1-9d40-d4a07a542afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:22.095603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 542/1079] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:22.360604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed40ab-e6cb-47eb-bb31-71bc0ce3ea5c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:22.461641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed40ab-e6cb-47eb-bb31-71bc0ce3ea5c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:22.494836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:22.495474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:22.495734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:22.496010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:22.506011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:22.510837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:22.511789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:22.512633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 538/1080] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:22.517965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b17b7a-3651-40f1-9d40-d4a07a542afe None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:22.530148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:22.618115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b17b7a-3651-40f1-9d40-d4a07a542afe None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:22.652041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:22.652649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:22.652931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:22.653203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:22.653896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:22.654202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:22.655562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:22.664110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 543/1081] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:22.670264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:22.681730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:22.778739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c875d6-c5a2-41eb-8356-973f0f879599 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:22.810462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:22.811082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:22.811360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:22.811633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] PATH_INFO: `/v3/users/0a33fb46c5674f59bd0588eb629fb132` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:22.812725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] RBAC: Authorizing `identity:get_user(user_id=0a33fb46c5674f59bd0588eb629fb132)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:22.814163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:22.815708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 539/1082] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:22 2022] GET /identity/v3/users/0a33fb46c5674f59bd0588eb629fb132 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:22.822107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:22.889741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:22.919756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae797aea-f619-4705-b4d0-5eda2130ca3c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:22.952541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3fe17-e805-443f-b48a-e2555f401298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:22.953162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fe17-e805-443f-b48a-e2555f401298 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:22.953438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fe17-e805-443f-b48a-e2555f401298 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:22.953709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3fe17-e805-443f-b48a-e2555f401298 None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:22.954823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3fe17-e805-443f-b48a-e2555f401298 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7229711a7348429703b6661517dc8d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:22.956234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3fe17-e805-443f-b48a-e2555f401298 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:22.957854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 544/1083] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:22 2022] GET /identity/v3/projects/7a7229711a7348429703b6661517dc8d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:22.964739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:23.040556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:23.062422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe49a6-4d18-43e5-9454-e0ec08fe26ce None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:23.096644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d42af-c48c-4f45-9821-76318c20f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:23.097302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d42af-c48c-4f45-9821-76318c20f922 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:23.097580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d42af-c48c-4f45-9821-76318c20f922 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:23.097889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d42af-c48c-4f45-9821-76318c20f922 None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d/users/0a33fb46c5674f59bd0588eb629fb132/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:23.099794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d42af-c48c-4f45-9821-76318c20f922 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a7229711a7348429703b6661517dc8d, user_id=0a33fb46c5674f59bd0588eb629fb132, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:23.101202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d42af-c48c-4f45-9821-76318c20f922 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:23.169226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 540/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:52:22 2022] PUT /identity/v3/projects/7a7229711a7348429703b6661517dc8d/users/0a33fb46c5674f59bd0588eb629fb132/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 15:52:23.980538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682d38-50eb-462c-a239-985308f85c7b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:23.981061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682d38-50eb-462c-a239-985308f85c7b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:23.981061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682d38-50eb-462c-a239-985308f85c7b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:23.982482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 545/1085] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:23.988916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765b25e-0925-4213-bfa8-ac1019086fd5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:23.989365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765b25e-0925-4213-bfa8-ac1019086fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:23.990140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765b25e-0925-4213-bfa8-ac1019086fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:24.008522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d765b25e-0925-4213-bfa8-ac1019086fd5 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:24.009690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d765b25e-0925-4213-bfa8-ac1019086fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:24.077723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 541/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:24.350623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682d38-50eb-462c-a239-985308f85c7b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:24.451901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682d38-50eb-462c-a239-985308f85c7b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:24.485339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:24.486000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:24.486286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:24.486564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:24.494936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:24.497949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:24.502713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:24.506176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:24.507217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 546/1087] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Oct 3 15:52:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:24.509789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765b25e-0925-4213-bfa8-ac1019086fd5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:24.581587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:24.629864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765b25e-0925-4213-bfa8-ac1019086fd5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:24.671650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:24.672257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:24.672539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:24.672819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:24.673588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:24.673932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:24.675298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:24.683106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 542/1088] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Oct 3 15:52:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:24.688989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:24.792046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924167ef-c71c-4f29-9a40-8e998bb9613f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:24.824930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:24.825559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:24.825875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:24.826155 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:24.837203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:24.838675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:24.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:24.860150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:24.861114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:24.861114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:24.861114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:24.861114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 547/1089] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:24.861351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:24.974676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da793aad-5510-4908-8f47-e4c0fda677fc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.000634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.009126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:25.009849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.010135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.010409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.011043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:25.011345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:25.012689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:25.024842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 543/1090] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:25.030590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:25.082758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.129391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a190e-0ef5-4493-a315-c4c9797803c0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.162733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b19e5-5e99-44d6-8d0a-ad1590f198fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:25.163350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b19e5-5e99-44d6-8d0a-ad1590f198fc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.163633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b19e5-5e99-44d6-8d0a-ad1590f198fc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.163901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b19e5-5e99-44d6-8d0a-ad1590f198fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.171296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b19e5-5e99-44d6-8d0a-ad1590f198fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:25.172718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b19e5-5e99-44d6-8d0a-ad1590f198fc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9a6b19e5-5e99-44d6-8d0a-ad1590f198fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:52:25.183576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:25.184535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:25.186058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 548/1091] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:25.190505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:25.293209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1447-a70f-47a5-872c-744b0cca3e57 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.325743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:25.326369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.326647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.326917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.327631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:25.327939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:25.329350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:25.346919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 544/1092] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:25.347600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec2b30-cfa1-411f-9e19-f4db3f987f68 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.347891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec2b30-cfa1-411f-9e19-f4db3f987f68 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.348184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec2b30-cfa1-411f-9e19-f4db3f987f68 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.349786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 549/1093] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:25.352583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:25.354665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32332-05e1-4180-89a1-80a68b83a68b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.354948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32332-05e1-4180-89a1-80a68b83a68b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.355221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32332-05e1-4180-89a1-80a68b83a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.373214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4bf32332-05e1-4180-89a1-80a68b83a68b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:25.374415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4bf32332-05e1-4180-89a1-80a68b83a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:25.400224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.441595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 550/1094] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:25.454017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953fdb-7f15-4d0d-8c0f-b0454c42474d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.487806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:25.488404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.488684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.488956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.556944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:25.558334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:25.602820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.655068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 545/1095] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 15:52:25.660875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32332-05e1-4180-89a1-80a68b83a68b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:25.707574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:25.709343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.767610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32332-05e1-4180-89a1-80a68b83a68b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.801313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:25.802001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.802387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.802671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.810329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e7d86-7187-41bc-b7c9-048af91bd2fe None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.812246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:25.813686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:25.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:25.829845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:52:25.830762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:25.830762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:52:25.830762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:25.830762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 551/1096] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:25.836744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:25.848160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:25.849354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.849823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.850104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.859894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:25.865163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:25.866229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:25.867530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 546/1097] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:25.872023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:25.880719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.931140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:25.937885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e42a-c796-4b47-b8e4-51d91b46dee7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.971443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:25.972035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:25.972339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:25.972606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:25.972750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143abd-ecd7-44c1-80b1-7a1958437434 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:25.973235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:25.973540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:25.975473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:25.986284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 552/1098] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:25.993301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:26.008673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.009283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.009574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.009883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.010548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:26.010856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.012218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.020166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 547/1099] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:26.026034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:26.090503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:26.094236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f1a0c-ea43-41a7-9009-251eb4992804 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:26.123381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ba189-0819-476c-8599-91b4720fd59b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:26.127575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.128195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.128471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.128796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.135338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.136760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:52:26.148289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:26.149186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:26.150144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 553/1100] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:52:26.155298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:26.160215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.160847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.161131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.162009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] PATH_INFO: `/v3/users/0a33fb46c5674f59bd0588eb629fb132` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.163293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] RBAC: Authorizing `identity:get_user(user_id=0a33fb46c5674f59bd0588eb629fb132)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.164712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.170870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 548/1101] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:26 2022] GET /identity/v3/users/0a33fb46c5674f59bd0588eb629fb132 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:26.171830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:26.172153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:26.254767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84354dec-337a-4baf-b7a0-15da821dc614 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:26.268020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f59cdb-dc58-48cb-aa4a-123c7cc67529 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:26.289470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.290107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.290398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.290674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.291361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:26.291669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.293096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.301132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.301730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.302056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.302327 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.304417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 554/1102] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:26.305646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:26.310470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:26.370350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.371850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.385061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:26.410180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb15d-f4f9-4cfe-a7e6-a7f5a2e547ab None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:26.444298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.444905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.445188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.445473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.446238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] RBAC: Adding query filter params (role.id=89d893f48d1c4858a86af30d5d6c779f, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=5550726a2c5e4aff9c16f509a3d1bb0a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:26.446558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.450742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.454038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 555/1103] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:26 2022] GET /identity/v3/role_assignments?user.id=5550726a2c5e4aff9c16f509a3d1bb0a&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=89d893f48d1c4858a86af30d5d6c779f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:26.471465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 549/1104] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 15:52:26.478276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:26.585352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eba409-0369-4d9c-b222-158f75acdf69 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:26.620968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912db58-0738-463f-b174-f6a70bb5fffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.621534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912db58-0738-463f-b174-f6a70bb5fffe None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.621841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912db58-0738-463f-b174-f6a70bb5fffe None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.622122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912db58-0738-463f-b174-f6a70bb5fffe None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.623258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912db58-0738-463f-b174-f6a70bb5fffe None admin] RBAC: Authorizing `identity:get_project(project_id=7a7229711a7348429703b6661517dc8d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.624692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912db58-0738-463f-b174-f6a70bb5fffe None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.626356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 556/1105] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:26 2022] GET /identity/v3/projects/7a7229711a7348429703b6661517dc8d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:26.633336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:26.669252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:26.742349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9464834-ce2e-44ca-aaa7-c82abc44017e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:26.775725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842255b-38d4-45bc-a84c-39552723e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:26.776321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842255b-38d4-45bc-a84c-39552723e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:26.776597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842255b-38d4-45bc-a84c-39552723e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:26.776867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842255b-38d4-45bc-a84c-39552723e1f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:26.777606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842255b-38d4-45bc-a84c-39552723e1f4 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=7a7229711a7348429703b6661517dc8d, user.id=0a33fb46c5674f59bd0588eb629fb132) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:26.777940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842255b-38d4-45bc-a84c-39552723e1f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:26.779353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842255b-38d4-45bc-a84c-39552723e1f4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:26.785039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 550/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:26 2022] GET /identity/v3/role_assignments?user.id=0a33fb46c5674f59bd0588eb629fb132&scope.project.id=7a7229711a7348429703b6661517dc8d&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:28.979969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74feb2e-d430-43d8-b879-4a376c0a7521 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:28.980490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74feb2e-d430-43d8-b879-4a376c0a7521 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:28.980576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74feb2e-d430-43d8-b879-4a376c0a7521 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:28.982084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 557/1107] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:28.987045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825557a-18bf-451d-bfa7-14651fffc06a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:28.987447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825557a-18bf-451d-bfa7-14651fffc06a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:28.987594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825557a-18bf-451d-bfa7-14651fffc06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:29.005595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5825557a-18bf-451d-bfa7-14651fffc06a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:29.006778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5825557a-18bf-451d-bfa7-14651fffc06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:29.070321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 551/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:29.340982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74feb2e-d430-43d8-b879-4a376c0a7521 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:29.350463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:29.440788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74feb2e-d430-43d8-b879-4a376c0a7521 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:29.476126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1ee36-d234-481e-ac89-00b4fed6c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:29.476748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1ee36-d234-481e-ac89-00b4fed6c3ae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:29.477029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1ee36-d234-481e-ac89-00b4fed6c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:29.477299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1ee36-d234-481e-ac89-00b4fed6c3ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:29.478401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1ee36-d234-481e-ac89-00b4fed6c3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:29.479827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1ee36-d234-481e-ac89-00b4fed6c3ae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:29.481358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 558/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:29.487131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825557a-18bf-451d-bfa7-14651fffc06a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:29.517100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:29.584841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825557a-18bf-451d-bfa7-14651fffc06a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:29.618081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432a6e1-8128-4a69-91d3-74987a0d1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:29.618680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a6e1-8128-4a69-91d3-74987a0d1b86 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:29.618963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a6e1-8128-4a69-91d3-74987a0d1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:29.619237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432a6e1-8128-4a69-91d3-74987a0d1b86 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:29.619895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a6e1-8128-4a69-91d3-74987a0d1b86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:29.621310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432a6e1-8128-4a69-91d3-74987a0d1b86 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:29.731228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 552/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:52:29 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 15:52:31.908693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfff05-d350-480c-81d1-6e6ab8208692 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:31.909242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfff05-d350-480c-81d1-6e6ab8208692 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:31.909242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfff05-d350-480c-81d1-6e6ab8208692 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:31.910606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 559/1111] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:31.916344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd8f1-5266-4aad-9d30-15f1302ff7b6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:31.916732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd8f1-5266-4aad-9d30-15f1302ff7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:31.916884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd8f1-5266-4aad-9d30-15f1302ff7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:31.935372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ee4cd8f1-5266-4aad-9d30-15f1302ff7b6 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:31.936529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ee4cd8f1-5266-4aad-9d30-15f1302ff7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:31.999880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 553/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:32.265668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfff05-d350-480c-81d1-6e6ab8208692 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:32.340092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:32.365208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfff05-d350-480c-81d1-6e6ab8208692 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:32.398023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:32.398661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:32.398937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:32.399207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] PATH_INFO: `/v3/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:32.400569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] RBAC: Authorizing `identity:get_role(role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:32.401951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:32.404432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 560/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:32 2022] GET /identity/v3/roles/4eba1d0edde84f6da82050340e36f845 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:32.409219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd8f1-5266-4aad-9d30-15f1302ff7b6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:32.426940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:32.579267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd8f1-5266-4aad-9d30-15f1302ff7b6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:32.612898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:32.613576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:32.613910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:32.614254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] PATH_INFO: `/v3/users/4699e7d6e76746d19cce976000509dd3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:32.627170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] RBAC: Authorizing `identity:get_user(user_id=4699e7d6e76746d19cce976000509dd3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:32.628608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:32.630764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 554/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:32 2022] GET /identity/v3/users/4699e7d6e76746d19cce976000509dd3 => generated 286 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:32.636709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:32.738412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230d77c-722c-4d0a-85fb-3a7f0dcc891c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:32.777424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:32.778056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:32.778339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:32.778615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:32.790801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:32.847409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:32.849314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:32.944195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 561/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:32.950293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:33.022859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:33.047520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534c168-e3fd-4378-a14c-46ccbca167af None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:33.079522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385170b6-336f-406b-b722-0649ba3d4291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:33.080163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385170b6-336f-406b-b722-0649ba3d4291 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:33.080471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385170b6-336f-406b-b722-0649ba3d4291 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:33.080744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385170b6-336f-406b-b722-0649ba3d4291 None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:33.081924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385170b6-336f-406b-b722-0649ba3d4291 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7229711a7348429703b6661517dc8d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:33.084326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385170b6-336f-406b-b722-0649ba3d4291 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:33.086452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 555/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:32 2022] GET /identity/v3/projects/7a7229711a7348429703b6661517dc8d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:33.092765 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:33.138962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:33.194500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5697f8-0c53-4a95-9ec5-599f83661488 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:33.228455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d202887-7040-4bf1-ae31-eb217101440d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:33.229045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202887-7040-4bf1-ae31-eb217101440d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:33.229325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202887-7040-4bf1-ae31-eb217101440d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:33.229595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202887-7040-4bf1-ae31-eb217101440d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:33.230338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d202887-7040-4bf1-ae31-eb217101440d None admin] RBAC: Adding query filter params (role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=7a7229711a7348429703b6661517dc8d, user.id=4699e7d6e76746d19cce976000509dd3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:33.230648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d202887-7040-4bf1-ae31-eb217101440d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:33.232063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d202887-7040-4bf1-ae31-eb217101440d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:33.237267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 562/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:33 2022] GET /identity/v3/role_assignments?user.id=4699e7d6e76746d19cce976000509dd3&scope.project.id=7a7229711a7348429703b6661517dc8d&role.id=4eba1d0edde84f6da82050340e36f845 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:35.358119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d53c4b-f01d-49d3-9645-07b07eccdf8e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:35.358648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d53c4b-f01d-49d3-9645-07b07eccdf8e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:35.358648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d53c4b-f01d-49d3-9645-07b07eccdf8e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:35.360014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 556/1118] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:35.365260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073a53d-7a88-4dc4-a5fc-c4b793ff7549 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:35.365674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073a53d-7a88-4dc4-a5fc-c4b793ff7549 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:35.365855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073a53d-7a88-4dc4-a5fc-c4b793ff7549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:35.384867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3073a53d-7a88-4dc4-a5fc-c4b793ff7549 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:35.386079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3073a53d-7a88-4dc4-a5fc-c4b793ff7549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:35.451356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 563/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:35.721905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d53c4b-f01d-49d3-9645-07b07eccdf8e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:35.822010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d53c4b-f01d-49d3-9645-07b07eccdf8e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:35.854643 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:35.855258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:35.855536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:35.855806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] PATH_INFO: `/v3/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:35.857160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] RBAC: Authorizing `identity:get_role(role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:35.858535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:35.859825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 557/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:35 2022] GET /identity/v3/roles/4eba1d0edde84f6da82050340e36f845 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:35.866467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073a53d-7a88-4dc4-a5fc-c4b793ff7549 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:35.900759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:35.964407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073a53d-7a88-4dc4-a5fc-c4b793ff7549 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:35.997401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:35.997986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:35.998266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:35.998538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] PATH_INFO: `/v3/users/4699e7d6e76746d19cce976000509dd3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:35.999631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] RBAC: Authorizing `identity:get_user(user_id=4699e7d6e76746d19cce976000509dd3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:36.001079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:36.002668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 564/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:35 2022] GET /identity/v3/users/4699e7d6e76746d19cce976000509dd3 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:36.008716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:36.022035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:36.108616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ac890-f4c7-4d71-b909-e5b1b1ef544a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:36.141386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf41237-b494-4507-a208-ceb9b6e8953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:36.142030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf41237-b494-4507-a208-ceb9b6e8953e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:36.142313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf41237-b494-4507-a208-ceb9b6e8953e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:36.142589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf41237-b494-4507-a208-ceb9b6e8953e None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:36.143684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf41237-b494-4507-a208-ceb9b6e8953e None admin] RBAC: Authorizing `identity:get_project(project_id=7a7229711a7348429703b6661517dc8d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:36.145102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf41237-b494-4507-a208-ceb9b6e8953e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:36.147860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 558/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:36 2022] GET /identity/v3/projects/7a7229711a7348429703b6661517dc8d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:36.153745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:36.250513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d4ac-1b52-4dae-878c-a7d35cc418b9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:36.252711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:36.283897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1607f-cc3b-4e64-a270-739f3cecb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:36.284535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1607f-cc3b-4e64-a270-739f3cecb34c None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:36.284813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1607f-cc3b-4e64-a270-739f3cecb34c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:36.285086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1607f-cc3b-4e64-a270-739f3cecb34c None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d/users/4699e7d6e76746d19cce976000509dd3/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:36.287290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1607f-cc3b-4e64-a270-739f3cecb34c None admin] RBAC: Authorizing `identity:create_grant(project_id=7a7229711a7348429703b6661517dc8d, user_id=4699e7d6e76746d19cce976000509dd3, role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:36.288707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1607f-cc3b-4e64-a270-739f3cecb34c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:36.341576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 565/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:52:36 2022] PUT /identity/v3/projects/7a7229711a7348429703b6661517dc8d/users/4699e7d6e76746d19cce976000509dd3/roles/4eba1d0edde84f6da82050340e36f845 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:52:38.460193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded803aa-cec9-4033-adcb-4aaacddecc2e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:38.460722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded803aa-cec9-4033-adcb-4aaacddecc2e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:38.460722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded803aa-cec9-4033-adcb-4aaacddecc2e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:38.462086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 559/1124] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 15:52:38.467202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffc4f-9fa9-43ee-af39-4349ab9b0f6a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:38.467600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffc4f-9fa9-43ee-af39-4349ab9b0f6a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:38.467761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fffc4f-9fa9-43ee-af39-4349ab9b0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:38.485528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-72fffc4f-9fa9-43ee-af39-4349ab9b0f6a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:38.486747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-72fffc4f-9fa9-43ee-af39-4349ab9b0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:38.551257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 566/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:38.821499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded803aa-cec9-4033-adcb-4aaacddecc2e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:38.898093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:38.919308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded803aa-cec9-4033-adcb-4aaacddecc2e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:38.950876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:38.951495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:38.951777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:38.952049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] PATH_INFO: `/v3/roles/4eba1d0edde84f6da82050340e36f845` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:38.953453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] RBAC: Authorizing `identity:get_role(role_id=4eba1d0edde84f6da82050340e36f845)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:38.954843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:38.960368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 560/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:38 2022] GET /identity/v3/roles/4eba1d0edde84f6da82050340e36f845 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:38.962661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fffc4f-9fa9-43ee-af39-4349ab9b0f6a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:39.051422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:39.058105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fffc4f-9fa9-43ee-af39-4349ab9b0f6a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:39.091108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:39.091772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:39.092052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:39.092333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] PATH_INFO: `/v3/users/4699e7d6e76746d19cce976000509dd3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:39.093439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] RBAC: Authorizing `identity:get_user(user_id=4699e7d6e76746d19cce976000509dd3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:39.094891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:39.099079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 567/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:38 2022] GET /identity/v3/users/4699e7d6e76746d19cce976000509dd3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:39.102737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:39.199300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe4da3-2e57-422e-abd3-a8889ad657e7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:39.232261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:39.232856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:39.233141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:39.233418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:39.248541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:39.298845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:39.300296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:39.394951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 561/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:39.401026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:39.501400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e4f16-b234-40f7-930b-e8d062296d38 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:39.533448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb36c33-2969-46fc-8ced-1116ea15fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:39.534090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36c33-2969-46fc-8ced-1116ea15fe24 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:39.534370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36c33-2969-46fc-8ced-1116ea15fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:39.534643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36c33-2969-46fc-8ced-1116ea15fe24 None admin] PATH_INFO: `/v3/projects/7a7229711a7348429703b6661517dc8d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:39.535728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb36c33-2969-46fc-8ced-1116ea15fe24 None admin] RBAC: Authorizing `identity:get_project(project_id=7a7229711a7348429703b6661517dc8d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:39.537828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb36c33-2969-46fc-8ced-1116ea15fe24 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:39.539425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 568/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:39 2022] GET /identity/v3/projects/7a7229711a7348429703b6661517dc8d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:39.545887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:39.590931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:39.642831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72e29e-dbcb-4512-a81b-966523dc6c72 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:39.675511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7460e-72b6-4af5-99c7-f1f3dad09a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:39.676054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7460e-72b6-4af5-99c7-f1f3dad09a7f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:39.676337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7460e-72b6-4af5-99c7-f1f3dad09a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:39.676612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7460e-72b6-4af5-99c7-f1f3dad09a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:39.677333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7460e-72b6-4af5-99c7-f1f3dad09a7f None admin] RBAC: Adding query filter params (role.id=4eba1d0edde84f6da82050340e36f845, scope.project.id=7a7229711a7348429703b6661517dc8d, user.id=4699e7d6e76746d19cce976000509dd3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:39.677640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7460e-72b6-4af5-99c7-f1f3dad09a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:39.679101 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7460e-72b6-4af5-99c7-f1f3dad09a7f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:39.684735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 562/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:39 2022] GET /identity/v3/role_assignments?user.id=4699e7d6e76746d19cce976000509dd3&scope.project.id=7a7229711a7348429703b6661517dc8d&role.id=4eba1d0edde84f6da82050340e36f845 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:41.838049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f5e2d-57b9-4c61-8e70-d2d7d662dff6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:41.838565 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f5e2d-57b9-4c61-8e70-d2d7d662dff6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:41.838674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f5e2d-57b9-4c61-8e70-d2d7d662dff6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:41.839926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 569/1131] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:41.845044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83441-26ec-447d-9233-383691512f68 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:41.845446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83441-26ec-447d-9233-383691512f68 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:41.845593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec83441-26ec-447d-9233-383691512f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:41.863864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7ec83441-26ec-447d-9233-383691512f68 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:41.865587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7ec83441-26ec-447d-9233-383691512f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:41.931115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 563/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:42.200044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f5e2d-57b9-4c61-8e70-d2d7d662dff6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:42.231245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:42.300688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f5e2d-57b9-4c61-8e70-d2d7d662dff6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:42.333367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47150f-156e-49cb-8258-d48764591bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:42.334247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47150f-156e-49cb-8258-d48764591bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:42.334535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47150f-156e-49cb-8258-d48764591bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:42.334800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47150f-156e-49cb-8258-d48764591bd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:42.335899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47150f-156e-49cb-8258-d48764591bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:42.337306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47150f-156e-49cb-8258-d48764591bd5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:42.338858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 570/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:42.344611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83441-26ec-447d-9233-383691512f68 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:42.384145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:42.444867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec83441-26ec-447d-9233-383691512f68 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:42.477705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14436a27-2462-4d68-bf7b-03c17339e186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:42.478270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14436a27-2462-4d68-bf7b-03c17339e186 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:42.478550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14436a27-2462-4d68-bf7b-03c17339e186 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:42.478822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14436a27-2462-4d68-bf7b-03c17339e186 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:42.479470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14436a27-2462-4d68-bf7b-03c17339e186 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:42.480881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14436a27-2462-4d68-bf7b-03c17339e186 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:42.565146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 564/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:52:42 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:52:44.731259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd0da-afce-4462-a9b5-037acbe82243 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:44.731785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd0da-afce-4462-a9b5-037acbe82243 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:44.731785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cd0da-afce-4462-a9b5-037acbe82243 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:44.733105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 571/1135] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:44.738319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c905f7f-4aea-4e6c-bcee-f65845117525 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:44.738738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c905f7f-4aea-4e6c-bcee-f65845117525 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:44.738970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c905f7f-4aea-4e6c-bcee-f65845117525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:44.757361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3c905f7f-4aea-4e6c-bcee-f65845117525 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:44.758578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3c905f7f-4aea-4e6c-bcee-f65845117525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:44.823400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 565/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:45.101958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cd0da-afce-4462-a9b5-037acbe82243 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:45.200911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:45.205535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cd0da-afce-4462-a9b5-037acbe82243 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:45.238419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70989cc0-4156-46f2-bcc5-4256c4d27f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:45.239976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989cc0-4156-46f2-bcc5-4256c4d27f69 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:45.240260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989cc0-4156-46f2-bcc5-4256c4d27f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:45.240533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70989cc0-4156-46f2-bcc5-4256c4d27f69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:45.241644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70989cc0-4156-46f2-bcc5-4256c4d27f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:45.243093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70989cc0-4156-46f2-bcc5-4256c4d27f69 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:45.244638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 572/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:52:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:45.250420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c905f7f-4aea-4e6c-bcee-f65845117525 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:45.273819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:45.347430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c905f7f-4aea-4e6c-bcee-f65845117525 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:45.379103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd41f03-1c7f-45c5-9edf-6ba545c718ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:45.380293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41f03-1c7f-45c5-9edf-6ba545c718ac None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:45.380581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41f03-1c7f-45c5-9edf-6ba545c718ac None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:45.380849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41f03-1c7f-45c5-9edf-6ba545c718ac None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:45.381479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd41f03-1c7f-45c5-9edf-6ba545c718ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:45.382920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd41f03-1c7f-45c5-9edf-6ba545c718ac None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:45.471885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 566/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:52:45 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:52:47.695240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94514d62-24f0-4c10-8376-600ddc24cb36 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:47.695802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94514d62-24f0-4c10-8376-600ddc24cb36 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:47.695802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94514d62-24f0-4c10-8376-600ddc24cb36 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:47.697094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 573/1139] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:47.702300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5000-1fd2-4cf8-95f1-a6b2938c14c0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:47.702720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5000-1fd2-4cf8-95f1-a6b2938c14c0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:47.702841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb5000-1fd2-4cf8-95f1-a6b2938c14c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:47.720986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a0bb5000-1fd2-4cf8-95f1-a6b2938c14c0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:47.722233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a0bb5000-1fd2-4cf8-95f1-a6b2938c14c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:47.787714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 567/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:48.064917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94514d62-24f0-4c10-8376-600ddc24cb36 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:48.170935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94514d62-24f0-4c10-8376-600ddc24cb36 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:48.204028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:48.204647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:48.204925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:48.205196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:48.216042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:48.220742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:48.221879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:48.222951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 574/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:48.228612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb5000-1fd2-4cf8-95f1-a6b2938c14c0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:48.238490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:48.325948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb5000-1fd2-4cf8-95f1-a6b2938c14c0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:48.359151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:48.359744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:48.360025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:48.360298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:48.360954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:48.361260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:48.362645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:48.370919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 568/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:48.376864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:48.405484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:48.478539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6335e2-c0a6-44bb-94e9-f550bf85a30f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:48.514535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:48.515337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:48.515616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:48.515886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] PATH_INFO: `/v3/users/7fcdb8f06d1446a187cb875a50050753` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:48.530256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] RBAC: Authorizing `identity:get_user(user_id=7fcdb8f06d1446a187cb875a50050753)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:48.531694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:48.533275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 575/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:48 2022] GET /identity/v3/users/7fcdb8f06d1446a187cb875a50050753 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:48.539147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:48.605889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:48.635676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a2cbe-cb91-4916-9c8b-15afeebdfc4a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:48.668070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:48.668669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:48.668951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:48.669224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:48.734255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:48.735701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:48.805655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:48.844263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 569/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:48.850290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:48.934251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:48.950520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05e9bc-c9de-4215-9fc2-234ec027fdd7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:48.983644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77845664-19af-4a9a-b327-366639abd3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:48.984260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77845664-19af-4a9a-b327-366639abd3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:48.984541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77845664-19af-4a9a-b327-366639abd3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:48.984816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77845664-19af-4a9a-b327-366639abd3b2 None admin] PATH_INFO: `/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:48.985943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77845664-19af-4a9a-b327-366639abd3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=dadd382bac824fe4a55b1ce8c80cbf13)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:48.987370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77845664-19af-4a9a-b327-366639abd3b2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:48.989958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 576/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:48 2022] GET /identity/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:48.996022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:49.092215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f80d-ea66-48f3-9f91-e6d67d24c7b0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:49.125202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f602a-169e-495e-bf50-d4289d8ab9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:49.125817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f602a-169e-495e-bf50-d4289d8ab9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:49.126097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f602a-169e-495e-bf50-d4289d8ab9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:49.126367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f602a-169e-495e-bf50-d4289d8ab9f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:49.127078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f602a-169e-495e-bf50-d4289d8ab9f8 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=dadd382bac824fe4a55b1ce8c80cbf13, user.id=7fcdb8f06d1446a187cb875a50050753) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:49.127387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f602a-169e-495e-bf50-d4289d8ab9f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:49.128794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f602a-169e-495e-bf50-d4289d8ab9f8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:49.134253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 570/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:48 2022] GET /identity/v3/role_assignments?user.id=7fcdb8f06d1446a187cb875a50050753&scope.project.id=dadd382bac824fe4a55b1ce8c80cbf13&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:51.252638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e638e10-e3b2-4738-ae69-2d1b9e1ac520 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:51.253231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e638e10-e3b2-4738-ae69-2d1b9e1ac520 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:51.253231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e638e10-e3b2-4738-ae69-2d1b9e1ac520 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:51.255066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 577/1147] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:51.260378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4687-e557-4b8e-b0eb-06631fd18a32 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:51.260780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4687-e557-4b8e-b0eb-06631fd18a32 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:51.260923 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e4687-e557-4b8e-b0eb-06631fd18a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:51.279008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c74e4687-e557-4b8e-b0eb-06631fd18a32 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:51.280164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c74e4687-e557-4b8e-b0eb-06631fd18a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:51.305567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:51.345033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 571/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:51.637619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e638e10-e3b2-4738-ae69-2d1b9e1ac520 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:51.753603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e638e10-e3b2-4738-ae69-2d1b9e1ac520 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:51.792380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:51.793073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:51.793347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:51.793616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:51.808290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:51.814030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:51.815258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:51.816531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 578/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:52:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:51.823132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e4687-e557-4b8e-b0eb-06631fd18a32 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:51.937497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e4687-e557-4b8e-b0eb-06631fd18a32 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:51.978250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:51.979780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:51.980064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:51.980344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:51.981026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:51.981332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:51.982891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:51.993998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 572/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:52:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:52.000160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:52.020379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:52.123858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16334b-4a8e-4cee-b740-2604d31d6367 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:52.165045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:52.165683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:52.166066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:52.166341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] PATH_INFO: `/v3/users/7fcdb8f06d1446a187cb875a50050753` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:52.167619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] RBAC: Authorizing `identity:get_user(user_id=7fcdb8f06d1446a187cb875a50050753)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:52.169170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:52.170792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 579/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:51 2022] GET /identity/v3/users/7fcdb8f06d1446a187cb875a50050753 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:52.177046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:52.207813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:52.289305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e465ee6-bf18-4b0a-bf49-85b1f4ee14c3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:52.322464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e8aa1-fbe9-404d-b1e9-27dbaf678b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:52.323081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8aa1-fbe9-404d-b1e9-27dbaf678b59 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:52.323360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8aa1-fbe9-404d-b1e9-27dbaf678b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:52.323628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8aa1-fbe9-404d-b1e9-27dbaf678b59 None admin] PATH_INFO: `/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:52.324728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e8aa1-fbe9-404d-b1e9-27dbaf678b59 None admin] RBAC: Authorizing `identity:get_project(project_id=dadd382bac824fe4a55b1ce8c80cbf13)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:52.326176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e8aa1-fbe9-404d-b1e9-27dbaf678b59 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:52.327799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 573/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:52 2022] GET /identity/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:52.334043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:52.415259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:52.433666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e9569-7f93-4d37-92cd-06bcf3ffdc72 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:52.474702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c695f7-bd03-46dd-a120-6ce7ad219b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:52.475613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c695f7-bd03-46dd-a120-6ce7ad219b43 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:52.476084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c695f7-bd03-46dd-a120-6ce7ad219b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:52.476505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c695f7-bd03-46dd-a120-6ce7ad219b43 None admin] PATH_INFO: `/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13/users/7fcdb8f06d1446a187cb875a50050753/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:52.479381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c695f7-bd03-46dd-a120-6ce7ad219b43 None admin] RBAC: Authorizing `identity:create_grant(project_id=dadd382bac824fe4a55b1ce8c80cbf13, user_id=7fcdb8f06d1446a187cb875a50050753, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:52.481664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c695f7-bd03-46dd-a120-6ce7ad219b43 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:52.554785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 580/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:52:52 2022] PUT /identity/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13/users/7fcdb8f06d1446a187cb875a50050753/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:52:54.679479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f56042-6a62-4b78-9591-71a57b1aab63 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:54.680015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f56042-6a62-4b78-9591-71a57b1aab63 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:54.680015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f56042-6a62-4b78-9591-71a57b1aab63 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:54.681353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 574/1154] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:54.686563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031684-3836-4b58-abd3-ca9c0f5da3dc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:54.686994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031684-3836-4b58-abd3-ca9c0f5da3dc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:54.687102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031684-3836-4b58-abd3-ca9c0f5da3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:54.705212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e4031684-3836-4b58-abd3-ca9c0f5da3dc None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:54.706408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e4031684-3836-4b58-abd3-ca9c0f5da3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:54.771012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 581/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:52:55.060345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f56042-6a62-4b78-9591-71a57b1aab63 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:55.144755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:55.152759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f56042-6a62-4b78-9591-71a57b1aab63 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:55.187579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:55.188227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:55.188507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:55.188781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:55.199136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:52:55.203916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:55.204999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:52:55.205933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 575/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:55.211947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4031684-3836-4b58-abd3-ca9c0f5da3dc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:55.277368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:55.307512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4031684-3836-4b58-abd3-ca9c0f5da3dc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:55.340622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:55.341126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:55.341402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:55.341672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:55.342353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:55.342652 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:55.344006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:55.352923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 582/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:55.358738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:55.458140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee3cbf-a5bf-4d10-8639-dfe1474a2c33 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:55.492264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:55.492886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:55.493166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:55.493439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] PATH_INFO: `/v3/users/7fcdb8f06d1446a187cb875a50050753` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:55.494696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=7fcdb8f06d1446a187cb875a50050753)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:55.496137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:55.497740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 576/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:52:55 2022] GET /identity/v3/users/7fcdb8f06d1446a187cb875a50050753 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:52:55.503547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:55.601475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e1faa-f673-45d9-a98c-0510fdacb06c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:55.628733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:55.633559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:55.634186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:55.634470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:55.634745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:55.700719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:55.702225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:55.799305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 583/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:55.806077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:55.832413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:55.906039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e215875-8d45-4cec-a2b3-de5389c8dbb8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:55.938791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c7dee-88ed-4fbd-8c24-44a86bad4b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:55.939406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c7dee-88ed-4fbd-8c24-44a86bad4b66 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:55.939687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c7dee-88ed-4fbd-8c24-44a86bad4b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:55.939957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c7dee-88ed-4fbd-8c24-44a86bad4b66 None admin] PATH_INFO: `/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:55.941034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c7dee-88ed-4fbd-8c24-44a86bad4b66 None admin] RBAC: Authorizing `identity:get_project(project_id=dadd382bac824fe4a55b1ce8c80cbf13)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:55.942621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c7dee-88ed-4fbd-8c24-44a86bad4b66 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:55.944211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 577/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:52:55 2022] GET /identity/v3/projects/dadd382bac824fe4a55b1ce8c80cbf13 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:55.950503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:55.980321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:56.048453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2654-a623-4845-9505-41f276f53a5b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:56.080875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964d56e-8836-45ee-be30-659bc0134c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:56.081464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964d56e-8836-45ee-be30-659bc0134c4b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:56.081741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964d56e-8836-45ee-be30-659bc0134c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:56.082039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964d56e-8836-45ee-be30-659bc0134c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:56.082799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964d56e-8836-45ee-be30-659bc0134c4b None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=dadd382bac824fe4a55b1ce8c80cbf13, user.id=7fcdb8f06d1446a187cb875a50050753) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:56.083099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964d56e-8836-45ee-be30-659bc0134c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:56.084782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964d56e-8836-45ee-be30-659bc0134c4b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:56.090275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 584/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:52:55 2022] GET /identity/v3/role_assignments?user.id=7fcdb8f06d1446a187cb875a50050753&scope.project.id=dadd382bac824fe4a55b1ce8c80cbf13&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:52:58.229452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9618-529e-442a-9513-bc20b3c4f8e1 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:58.230006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9618-529e-442a-9513-bc20b3c4f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:58.230006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9618-529e-442a-9513-bc20b3c4f8e1 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:58.231350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 578/1162] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:52:58.236516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b010ed-2b6b-4a14-b1c7-8f51b61744c4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:58.236924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b010ed-2b6b-4a14-b1c7-8f51b61744c4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:58.237072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b010ed-2b6b-4a14-b1c7-8f51b61744c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:58.255825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-83b010ed-2b6b-4a14-b1c7-8f51b61744c4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:52:58.257050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-83b010ed-2b6b-4a14-b1c7-8f51b61744c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:52:58.322312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 585/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:52:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:52:58.602409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba9618-529e-442a-9513-bc20b3c4f8e1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:58.691514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:58.701563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba9618-529e-442a-9513-bc20b3c4f8e1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:58.736280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:58.736884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:58.737162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:58.737429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:58.802000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:58.803427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:58.890812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:58.901454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 579/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:52:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:52:58.907488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b010ed-2b6b-4a14-b1c7-8f51b61744c4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:58.933195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:52:59.002813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b010ed-2b6b-4a14-b1c7-8f51b61744c4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:59.035891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee25299-5894-4668-b1dc-38216db088e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:59.036505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25299-5894-4668-b1dc-38216db088e0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:59.036784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25299-5894-4668-b1dc-38216db088e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:59.037059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25299-5894-4668-b1dc-38216db088e0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:59.043415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee25299-5894-4668-b1dc-38216db088e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:59.044839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee25299-5894-4668-b1dc-38216db088e0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1ee25299-5894-4668-b1dc-38216db088e0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:52:59.056602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:52:59.057820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:52:59.058711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 586/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:52:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:52:59.063643 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:52:59.159584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170efa-8cd3-4d14-93b2-5be12f2e60f0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:52:59.193639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc5212-8d31-4c08-bc18-737d566e575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:52:59.194269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5212-8d31-4c08-bc18-737d566e575f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:52:59.194554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5212-8d31-4c08-bc18-737d566e575f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:52:59.194829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc5212-8d31-4c08-bc18-737d566e575f None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:52:59.195468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5212-8d31-4c08-bc18-737d566e575f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:52:59.195773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5212-8d31-4c08-bc18-737d566e575f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:52:59.197150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc5212-8d31-4c08-bc18-737d566e575f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:52:59.205050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 580/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Oct 3 15:52:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:01.348458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab87c-cc00-4ebe-8aec-a4f581f8c414 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:01.349160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab87c-cc00-4ebe-8aec-a4f581f8c414 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:01.349160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab87c-cc00-4ebe-8aec-a4f581f8c414 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:01.350366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 587/1167] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:53:01.355547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735345cd-f4ad-4d0b-a675-1d8fd79e0258 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:01.355974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735345cd-f4ad-4d0b-a675-1d8fd79e0258 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:01.356081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735345cd-f4ad-4d0b-a675-1d8fd79e0258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:01.375098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-735345cd-f4ad-4d0b-a675-1d8fd79e0258 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:53:01.376262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-735345cd-f4ad-4d0b-a675-1d8fd79e0258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:53:01.423385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:01.439724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 581/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:53:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:53:01.741017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fab87c-cc00-4ebe-8aec-a4f581f8c414 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:01.825196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:01.841057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fab87c-cc00-4ebe-8aec-a4f581f8c414 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:01.874154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ea7e6-a9e5-41ab-8157-097ea5b6289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:01.874758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea7e6-a9e5-41ab-8157-097ea5b6289c None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:01.875041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea7e6-a9e5-41ab-8157-097ea5b6289c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:01.875316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ea7e6-a9e5-41ab-8157-097ea5b6289c None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:01.875981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ea7e6-a9e5-41ab-8157-097ea5b6289c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:01.877352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ea7e6-a9e5-41ab-8157-097ea5b6289c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:01.932977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 588/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Mon Oct 3 15:53:01 2022] POST /identity/v3/domains => generated 267 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:53:04.118498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2c89-e60c-45b5-996c-21424bd90211 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:04.119008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2c89-e60c-45b5-996c-21424bd90211 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:04.119119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de2c89-e60c-45b5-996c-21424bd90211 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:04.120386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 582/1170] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:53:04.125657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859d9e-bda6-4f52-bed9-51299b657d04 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:04.126118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859d9e-bda6-4f52-bed9-51299b657d04 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:04.126247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859d9e-bda6-4f52-bed9-51299b657d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:04.144361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-95859d9e-bda6-4f52-bed9-51299b657d04 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:53:04.145849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-95859d9e-bda6-4f52-bed9-51299b657d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:53:04.211650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 589/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:53:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:53:04.487654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2c89-e60c-45b5-996c-21424bd90211 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:04.587243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de2c89-e60c-45b5-996c-21424bd90211 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:04.620776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c336a02-eb8f-4a8e-aa05-4f6f8da0ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:04.621395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c336a02-eb8f-4a8e-aa05-4f6f8da0ef6f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:04.621674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c336a02-eb8f-4a8e-aa05-4f6f8da0ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:04.621979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c336a02-eb8f-4a8e-aa05-4f6f8da0ef6f None admin] PATH_INFO: `/v3/domains/5519e81e745c43baa1beed2f26ac14e3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:04.632408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c336a02-eb8f-4a8e-aa05-4f6f8da0ef6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=5519e81e745c43baa1beed2f26ac14e3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:04.633868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c336a02-eb8f-4a8e-aa05-4f6f8da0ef6f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:04.635497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 583/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Oct 3 15:53:04 2022] GET /identity/v3/domains/5519e81e745c43baa1beed2f26ac14e3 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:04.641349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859d9e-bda6-4f52-bed9-51299b657d04 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:04.714509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:04.737439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859d9e-bda6-4f52-bed9-51299b657d04 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:04.772260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1e5bd-f75a-4caf-abdb-33409789ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:04.772791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1e5bd-f75a-4caf-abdb-33409789ae67 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:04.773070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1e5bd-f75a-4caf-abdb-33409789ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:04.773339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1e5bd-f75a-4caf-abdb-33409789ae67 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:04.774013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1e5bd-f75a-4caf-abdb-33409789ae67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:04.775451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1e5bd-f75a-4caf-abdb-33409789ae67 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:04.850962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 590/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:53:04 2022] POST /identity/v3/projects => generated 361 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 15:53:07.018202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26fd8-21f9-438d-8a44-c6d0fda6cce3 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:07.018714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26fd8-21f9-438d-8a44-c6d0fda6cce3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:07.018714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26fd8-21f9-438d-8a44-c6d0fda6cce3 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:07.020063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 584/1174] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:53:07.025292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337eb0-d1f0-47b1-be6b-a85f32d6346a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:07.025666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337eb0-d1f0-47b1-be6b-a85f32d6346a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:07.025884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65337eb0-d1f0-47b1-be6b-a85f32d6346a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:07.044126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-65337eb0-d1f0-47b1-be6b-a85f32d6346a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:53:07.045291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-65337eb0-d1f0-47b1-be6b-a85f32d6346a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:53:07.109074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 591/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:53:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:53:07.380142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d26fd8-21f9-438d-8a44-c6d0fda6cce3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:07.430100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:07.485348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d26fd8-21f9-438d-8a44-c6d0fda6cce3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:07.517799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86aa7a-3bff-4d49-b068-7f73635ff94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:07.518409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86aa7a-3bff-4d49-b068-7f73635ff94e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:07.518693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86aa7a-3bff-4d49-b068-7f73635ff94e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:07.518970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86aa7a-3bff-4d49-b068-7f73635ff94e None admin] PATH_INFO: `/v3/domains/5519e81e745c43baa1beed2f26ac14e3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:07.520598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86aa7a-3bff-4d49-b068-7f73635ff94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=5519e81e745c43baa1beed2f26ac14e3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:07.522037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86aa7a-3bff-4d49-b068-7f73635ff94e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:07.523597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 585/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Oct 3 15:53:07 2022] GET /identity/v3/domains/5519e81e745c43baa1beed2f26ac14e3 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:07.529337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337eb0-d1f0-47b1-be6b-a85f32d6346a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:07.588917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:07.630429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65337eb0-d1f0-47b1-be6b-a85f32d6346a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:07.672231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277fe0-c021-4f82-8fde-76bd78f71a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:07.672836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277fe0-c021-4f82-8fde-76bd78f71a6c None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:07.673111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277fe0-c021-4f82-8fde-76bd78f71a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:07.673381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277fe0-c021-4f82-8fde-76bd78f71a6c None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:07.674056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277fe0-c021-4f82-8fde-76bd78f71a6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:07.675477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c277fe0-c021-4f82-8fde-76bd78f71a6c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:07.741498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 592/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:53:07 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:53:09.922942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a12b5-c95b-4820-bf28-b4adc878882a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:09.923498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a12b5-c95b-4820-bf28-b4adc878882a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:09.923600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a12b5-c95b-4820-bf28-b4adc878882a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:09.924898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 586/1178] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:53:09.930830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ecdab-b5cd-4456-9efc-070f04050c0a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:09.931268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ecdab-b5cd-4456-9efc-070f04050c0a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:09.931360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ecdab-b5cd-4456-9efc-070f04050c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:09.948906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1d2ecdab-b5cd-4456-9efc-070f04050c0a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:53:09.950105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1d2ecdab-b5cd-4456-9efc-070f04050c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:53:10.014210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 593/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:53:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:53:10.292181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a12b5-c95b-4820-bf28-b4adc878882a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:10.393635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a12b5-c95b-4820-bf28-b4adc878882a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:10.407067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:10.428007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:10.428636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:10.428920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:10.429198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:10.438859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:53:10.444759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:53:10.445734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:53:10.447054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 587/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:53:10.451937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ecdab-b5cd-4456-9efc-070f04050c0a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:10.497804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:10.551925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ecdab-b5cd-4456-9efc-070f04050c0a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:10.585326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:10.585952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:10.586292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:10.586559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:10.587212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:53:10.587511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:10.588866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:10.597107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 594/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:10.603223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:10.703810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f18e0-c6f6-41d8-bdbc-9a38ce275649 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:10.737589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:10.738775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:10.739058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:10.739349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] PATH_INFO: `/v3/users/0d7be7bd0b474a5daabe6883deb2595a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:10.752616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] RBAC: Authorizing `identity:get_user(user_id=0d7be7bd0b474a5daabe6883deb2595a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:10.754753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:10.756331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 588/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:53:10 2022] GET /identity/v3/users/0d7be7bd0b474a5daabe6883deb2595a => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:10.762129 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:10.857358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118f68-9fe4-40f6-88d8-0b5b583fcc93 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:10.865104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:10.890371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:10.891225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:10.891816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:10.892159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:10.960951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:10.962479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:11.060296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 595/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:53:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:53:11.066326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:11.096349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:11.165302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f70835-aa2a-42de-9c93-b6b52e10b464 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:11.198134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7fa80-95b9-4220-9bea-a002939c28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:11.198747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7fa80-95b9-4220-9bea-a002939c28a9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:11.199030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7fa80-95b9-4220-9bea-a002939c28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:11.199307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7fa80-95b9-4220-9bea-a002939c28a9 None admin] PATH_INFO: `/v3/projects/d61cccaaaec143449c306b56754a895a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:11.200392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7fa80-95b9-4220-9bea-a002939c28a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d61cccaaaec143449c306b56754a895a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:11.201826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7fa80-95b9-4220-9bea-a002939c28a9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:11.203419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 589/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:53:11 2022] GET /identity/v3/projects/d61cccaaaec143449c306b56754a895a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:11.210370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:11.218397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:11.314966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7b360-fe9b-49fd-9794-5acb6839539e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:11.350141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456aa95-ba23-40bc-a1fb-280d411d3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:11.350743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456aa95-ba23-40bc-a1fb-280d411d3278 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:11.351023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456aa95-ba23-40bc-a1fb-280d411d3278 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:11.351314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456aa95-ba23-40bc-a1fb-280d411d3278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:11.352004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456aa95-ba23-40bc-a1fb-280d411d3278 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=d61cccaaaec143449c306b56754a895a, user.id=0d7be7bd0b474a5daabe6883deb2595a) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:53:11.352313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456aa95-ba23-40bc-a1fb-280d411d3278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:11.353739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456aa95-ba23-40bc-a1fb-280d411d3278 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:11.358978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 596/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:53:11 2022] GET /identity/v3/role_assignments?user.id=0d7be7bd0b474a5daabe6883deb2595a&scope.project.id=d61cccaaaec143449c306b56754a895a&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:13.489535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de46b4-ed38-4fde-9ba4-dc2de4fabe6f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:13.490265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de46b4-ed38-4fde-9ba4-dc2de4fabe6f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:13.490265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de46b4-ed38-4fde-9ba4-dc2de4fabe6f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:13.491423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 590/1186] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:53:13.496610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a154e-1a6a-444e-9777-75be9f1b9747 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:13.496994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a154e-1a6a-444e-9777-75be9f1b9747 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:13.497178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a154e-1a6a-444e-9777-75be9f1b9747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:13.515495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-656a154e-1a6a-444e-9777-75be9f1b9747 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:53:13.516731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-656a154e-1a6a-444e-9777-75be9f1b9747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:53:13.577177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:13.581566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 597/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:53:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:53:13.854723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de46b4-ed38-4fde-9ba4-dc2de4fabe6f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:13.948456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:13.953034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de46b4-ed38-4fde-9ba4-dc2de4fabe6f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:13.986239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:13.986858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:13.987139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:13.987413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:13.997699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:53:14.002461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:53:14.003543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:53:14.004459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 591/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:53:14.009588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a154e-1a6a-444e-9777-75be9f1b9747 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:14.105361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a154e-1a6a-444e-9777-75be9f1b9747 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:14.139640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58964959-41af-437e-a4a7-180de9142600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:14.140244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58964959-41af-437e-a4a7-180de9142600 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:14.140527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58964959-41af-437e-a4a7-180de9142600 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:14.140802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58964959-41af-437e-a4a7-180de9142600 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:14.141459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58964959-41af-437e-a4a7-180de9142600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:53:14.141792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58964959-41af-437e-a4a7-180de9142600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:14.143160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58964959-41af-437e-a4a7-180de9142600 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:14.151486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 598/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:14.157337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:14.255085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f326e-61b8-4c17-8ff9-2b49e41fcf53 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:14.288546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:14.289154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:14.289435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:14.289708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] PATH_INFO: `/v3/users/0d7be7bd0b474a5daabe6883deb2595a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:14.290844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] RBAC: Authorizing `identity:get_user(user_id=0d7be7bd0b474a5daabe6883deb2595a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:14.292270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:14.293848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 592/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:53:14 2022] GET /identity/v3/users/0d7be7bd0b474a5daabe6883deb2595a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:14.299525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58964959-41af-437e-a4a7-180de9142600 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:14.360246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:14.401308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58964959-41af-437e-a4a7-180de9142600 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:14.434335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a541bc-1c8f-4d59-9424-168f79d6ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:14.434964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a541bc-1c8f-4d59-9424-168f79d6ffa0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:14.435249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a541bc-1c8f-4d59-9424-168f79d6ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:14.435528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a541bc-1c8f-4d59-9424-168f79d6ffa0 None admin] PATH_INFO: `/v3/projects/d61cccaaaec143449c306b56754a895a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:14.436639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a541bc-1c8f-4d59-9424-168f79d6ffa0 None admin] RBAC: Authorizing `identity:get_project(project_id=d61cccaaaec143449c306b56754a895a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:14.438106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a541bc-1c8f-4d59-9424-168f79d6ffa0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:14.439759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 599/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:53:14 2022] GET /identity/v3/projects/d61cccaaaec143449c306b56754a895a => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:14.445808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:14.473954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:14.542823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d4e78-070f-4e2d-ba14-bb46905e85e9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:14.575577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77fa63-2f21-4715-a1b6-77eccfde9b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:14.576222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77fa63-2f21-4715-a1b6-77eccfde9b46 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:14.576498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77fa63-2f21-4715-a1b6-77eccfde9b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:14.576766 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77fa63-2f21-4715-a1b6-77eccfde9b46 None admin] PATH_INFO: `/v3/projects/d61cccaaaec143449c306b56754a895a/users/0d7be7bd0b474a5daabe6883deb2595a/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:14.578628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77fa63-2f21-4715-a1b6-77eccfde9b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=d61cccaaaec143449c306b56754a895a, user_id=0d7be7bd0b474a5daabe6883deb2595a, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:14.580061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77fa63-2f21-4715-a1b6-77eccfde9b46 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:14.632708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 593/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:53:14 2022] PUT /identity/v3/projects/d61cccaaaec143449c306b56754a895a/users/0d7be7bd0b474a5daabe6883deb2595a/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:53:16.729530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77287f-ad1c-49d5-92bd-f36d53a8716c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:16.730078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77287f-ad1c-49d5-92bd-f36d53a8716c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:16.730186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77287f-ad1c-49d5-92bd-f36d53a8716c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:16.731425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 600/1193] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:53:16.736856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed399b48-8c73-42c7-9ca3-2f26a189677c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:16.737226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed399b48-8c73-42c7-9ca3-2f26a189677c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:16.737415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed399b48-8c73-42c7-9ca3-2f26a189677c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:16.755882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ed399b48-8c73-42c7-9ca3-2f26a189677c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:53:16.757056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ed399b48-8c73-42c7-9ca3-2f26a189677c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:53:16.822582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 594/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:53:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:53:17.100292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77287f-ad1c-49d5-92bd-f36d53a8716c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:17.200842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77287f-ad1c-49d5-92bd-f36d53a8716c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:17.229363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:17.234977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:17.235598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:17.235882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:17.236160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:17.246527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:53:17.251672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:53:17.252779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:53:17.254451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 601/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:53:17.260119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed399b48-8c73-42c7-9ca3-2f26a189677c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:17.276878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:17.357577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed399b48-8c73-42c7-9ca3-2f26a189677c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:17.390291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:17.390877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:17.391151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:17.391417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:17.392068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:53:17.392366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:17.393701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:17.402341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 595/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:17.408343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:17.509175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06e502-575e-4b2a-87d3-a171da860309 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:17.543059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:17.543676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:17.543959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:17.544236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] PATH_INFO: `/v3/users/0d7be7bd0b474a5daabe6883deb2595a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:17.545349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=0d7be7bd0b474a5daabe6883deb2595a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:17.546816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:17.548370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 602/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Oct 3 15:53:17 2022] GET /identity/v3/users/0d7be7bd0b474a5daabe6883deb2595a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:17.554386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:17.630743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:17.651273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830b687-cd96-4307-80e4-61a1edeb91c9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:17.688024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:17.688618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:17.688898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:17.689167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:17.759160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:17.760598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:17.832753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:17.854172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 596/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:53:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:53:17.860366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:17.918686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:17.959686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ddd7-da4b-4451-bdd3-aa043a57c0b3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:17.992193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4e86a-dd63-4bd0-b33c-04e4b459d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:17.992806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e86a-dd63-4bd0-b33c-04e4b459d821 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:17.993083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e86a-dd63-4bd0-b33c-04e4b459d821 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:17.993353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4e86a-dd63-4bd0-b33c-04e4b459d821 None admin] PATH_INFO: `/v3/projects/d61cccaaaec143449c306b56754a895a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:17.994477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4e86a-dd63-4bd0-b33c-04e4b459d821 None admin] RBAC: Authorizing `identity:get_project(project_id=d61cccaaaec143449c306b56754a895a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:17.995897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4e86a-dd63-4bd0-b33c-04e4b459d821 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:17.997481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 603/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Oct 3 15:53:17 2022] GET /identity/v3/projects/d61cccaaaec143449c306b56754a895a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:18.003710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:53:18.098326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870140b1-f046-49b8-ade0-9c488b92159e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:53:18.131031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab5ecd-bb3d-4d47-a5aa-27c09e067645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:53:18.131627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab5ecd-bb3d-4d47-a5aa-27c09e067645 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:53:18.131909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab5ecd-bb3d-4d47-a5aa-27c09e067645 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:53:18.132180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab5ecd-bb3d-4d47-a5aa-27c09e067645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:53:18.132900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab5ecd-bb3d-4d47-a5aa-27c09e067645 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=d61cccaaaec143449c306b56754a895a, user.id=0d7be7bd0b474a5daabe6883deb2595a) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:53:18.133211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab5ecd-bb3d-4d47-a5aa-27c09e067645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:53:18.134658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab5ecd-bb3d-4d47-a5aa-27c09e067645 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:53:18.140246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 597/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:53:18 2022] GET /identity/v3/role_assignments?user.id=0d7be7bd0b474a5daabe6883deb2595a&scope.project.id=d61cccaaaec143449c306b56754a895a&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:53:27.988258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=37 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:53:28.137633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=79 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:28.779398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83daf-20e6-4c81-af6b-b67309699806 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:28.779959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83daf-20e6-4c81-af6b-b67309699806 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:28.779959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd83daf-20e6-4c81-af6b-b67309699806 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:28.781291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 604/1201] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:28.786569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef2d52-5bac-4045-b4e8-297218381e9b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:28.786993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef2d52-5bac-4045-b4e8-297218381e9b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:28.787112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef2d52-5bac-4045-b4e8-297218381e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:28.805569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-36ef2d52-5bac-4045-b4e8-297218381e9b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:28.806832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-36ef2d52-5bac-4045-b4e8-297218381e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:28.872183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 598/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:54:29.150355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd83daf-20e6-4c81-af6b-b67309699806 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:29.253049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd83daf-20e6-4c81-af6b-b67309699806 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:29.288134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:29.289249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:29.289541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:29.289847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:29.300233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:29.301677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:29.316429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:29.317917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:29.319173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:29.319173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:29.319173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:29.319173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 605/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:29.324860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef2d52-5bac-4045-b4e8-297218381e9b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:29.421511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef2d52-5bac-4045-b4e8-297218381e9b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:29.450036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:29.455654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ceea4-eb20-4625-8d9b-187d97fd388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:29.456350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ceea4-eb20-4625-8d9b-187d97fd388d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:29.456633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ceea4-eb20-4625-8d9b-187d97fd388d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:29.456909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ceea4-eb20-4625-8d9b-187d97fd388d None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:29.457550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ceea4-eb20-4625-8d9b-187d97fd388d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:29.457890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ceea4-eb20-4625-8d9b-187d97fd388d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:29.459452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ceea4-eb20-4625-8d9b-187d97fd388d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:29.470839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 599/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:29.476848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:29.528850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:29.575436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29a070-2e51-4eb9-b0c9-a4b3309c9557 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:29.609807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4b477-f9a7-4fb6-8926-17edec2768fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:29.610428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b477-f9a7-4fb6-8926-17edec2768fd None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:29.610700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b477-f9a7-4fb6-8926-17edec2768fd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:29.610980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b477-f9a7-4fb6-8926-17edec2768fd None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:29.611619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4b477-f9a7-4fb6-8926-17edec2768fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:29.613247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4b477-f9a7-4fb6-8926-17edec2768fd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:29.713209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 606/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Oct 3 15:54:29 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:54:31.942844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa39f-8a1c-4c5c-b116-5b7110b615ee None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:31.943394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa39f-8a1c-4c5c-b116-5b7110b615ee None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:31.943488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa39f-8a1c-4c5c-b116-5b7110b615ee None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:31.945343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 600/1206] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:31.950878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49244ad-74c0-4dcd-88f3-351e0993e5cf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:31.951315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49244ad-74c0-4dcd-88f3-351e0993e5cf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:31.951419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49244ad-74c0-4dcd-88f3-351e0993e5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:31.970439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d49244ad-74c0-4dcd-88f3-351e0993e5cf None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:31.971776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d49244ad-74c0-4dcd-88f3-351e0993e5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:32.038359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 607/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:54:32.326146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa39f-8a1c-4c5c-b116-5b7110b615ee None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:32.430487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa39f-8a1c-4c5c-b116-5b7110b615ee None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:32.464198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:32.464817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:32.465094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:32.465361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:32.475153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:54:32.480644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:32.485856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:32.486953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 601/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:54:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:32.487851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49244ad-74c0-4dcd-88f3-351e0993e5cf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:32.530608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:32.590525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49244ad-74c0-4dcd-88f3-351e0993e5cf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:32.624824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:32.625421 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:32.625699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:32.625997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:32.626688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:32.626990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:32.628364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:32.635986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 608/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:54:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:32.642124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:32.692282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:32.741617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ab0e7-c906-4d62-9c35-6bd7d3028fc3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:32.774303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:32.774918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:32.775200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:32.775472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:32.785528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:32.786998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:32.801613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:32.802795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:32.803869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:32.803869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:32.803869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:32.803869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 602/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:32.809262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:32.905628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:32.908597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3a62d-7fca-4551-a0ce-285faab65a83 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:32.941039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:32.941782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:32.942083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:32.942356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:32.942990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:32.943295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:32.944652 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:32.956490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 609/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:32.963312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:33.063896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b2da2-047e-449a-89b0-d3f2d27a9ac8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:33.065386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:33.098321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:33.098942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:33.099224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:33.099497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:33.106685 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:33.108122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:54:33.120391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:33.121689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:33.122934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 603/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:33.127451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:33.228066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d61d5-a982-4470-8e6e-32d9312f0d4d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:33.262240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:33.262832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:33.263111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:33.263383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:33.264139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:33.264494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:33.265949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:33.282684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 610/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Oct 3 15:54:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:33.288506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:33.390339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e354b90-46d2-4dce-8924-8c97b45d3382 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:33.427230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:33.427941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:33.428214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:33.428489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:33.458690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:33.498364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:33.499751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:33.596404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 604/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:54:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:54:33.602804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:33.621868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:33.701717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef754e9c-bf81-470f-8ec8-e841177d7f6c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:33.743176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:33.743813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:33.744092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:33.744363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:33.755093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:33.756477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:33.771223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:33.772403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:33.773616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:33.773616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:33.773616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:33.773616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 611/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:33.778102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:33.838417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:33.877057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fff536-d8c6-4738-a13b-121d8f2c119a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:33.909716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:33.910373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:33.910657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:33.910932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:33.911566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:33.911870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:33.913225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:33.926177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 605/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:33.932203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:34.001419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:34.032235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90babe4-6cc8-4508-9272-0136dd85dd80 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:34.065805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:34.066429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:34.066711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:34.066986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:34.073625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:34.075101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:54:34.087960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:34.089081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:34.090005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 612/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:34.094945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:34.191896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc31f0-4a89-4a0d-9aeb-0dddac8e7096 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:34.215109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:34.227021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07599-ca76-41ae-a33f-4279aae2eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:34.227451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07599-ca76-41ae-a33f-4279aae2eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:34.227727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07599-ca76-41ae-a33f-4279aae2eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:34.227994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07599-ca76-41ae-a33f-4279aae2eeb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:34.228671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07599-ca76-41ae-a33f-4279aae2eeb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:34.228972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07599-ca76-41ae-a33f-4279aae2eeb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:34.230453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07599-ca76-41ae-a33f-4279aae2eeb4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:34.242211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 606/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:54:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:34.248653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:34.349201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ed208-f688-4942-8483-3f53387f6f3a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:34.376613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:34.382775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dc8ff-5d60-40c9-8d2a-0bba08291369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:34.383563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dc8ff-5d60-40c9-8d2a-0bba08291369 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:34.383841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dc8ff-5d60-40c9-8d2a-0bba08291369 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:34.384109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dc8ff-5d60-40c9-8d2a-0bba08291369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:34.384811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dc8ff-5d60-40c9-8d2a-0bba08291369 None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=e33f20c6985d48a0948969182d38ca08) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:34.385113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dc8ff-5d60-40c9-8d2a-0bba08291369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:34.386618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dc8ff-5d60-40c9-8d2a-0bba08291369 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:34.391806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 613/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:54:34 2022] GET /identity/v3/role_assignments?user.id=e33f20c6985d48a0948969182d38ca08&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:54:36.514803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852c5e-b615-4553-b903-8a8e86ea5703 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:36.515340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852c5e-b615-4553-b903-8a8e86ea5703 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:36.515340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852c5e-b615-4553-b903-8a8e86ea5703 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:36.516684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 607/1220] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:36.522346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7313ea-08c6-42d7-8a16-68960665b193 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:36.523331 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7313ea-08c6-42d7-8a16-68960665b193 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:36.523858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7313ea-08c6-42d7-8a16-68960665b193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:36.542769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3b7313ea-08c6-42d7-8a16-68960665b193 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:36.543950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3b7313ea-08c6-42d7-8a16-68960665b193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:36.611908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 614/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:54:36.886241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5852c5e-b615-4553-b903-8a8e86ea5703 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:36.990335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5852c5e-b615-4553-b903-8a8e86ea5703 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:37.024601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358365-38f2-4127-90cc-32135c71170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:37.025219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358365-38f2-4127-90cc-32135c71170b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:37.025499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358365-38f2-4127-90cc-32135c71170b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:37.025843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358365-38f2-4127-90cc-32135c71170b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:37.035905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13358365-38f2-4127-90cc-32135c71170b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-13358365-38f2-4127-90cc-32135c71170b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:54:37.041313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:37.042485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:37.043445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 608/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:54:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:37.048495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7313ea-08c6-42d7-8a16-68960665b193 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:37.153889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7313ea-08c6-42d7-8a16-68960665b193 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:37.177328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:37.187788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:37.188386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:37.188691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:37.188935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:37.189583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:37.189917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:37.191275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:37.199093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 615/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:54:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:37.204988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358365-38f2-4127-90cc-32135c71170b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:37.250628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:37.303366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358365-38f2-4127-90cc-32135c71170b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:37.337959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:37.338594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:37.338878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:37.339149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:37.349061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:37.350580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:37.364850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:37.366016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:37.367169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:37.367169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:37.367169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:37.367169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 609/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:37.371937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:37.471689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8388e-a424-47d1-b07d-0bbe820d9adb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:37.505142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:37.505753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:37.506146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:37.506423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:37.507061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:37.508466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:37.509864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:37.521377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 616/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:37.527834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:37.620776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:37.627235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6f37c-c519-40dc-ba10-75b123207107 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:37.660019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:37.660667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:37.660949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:37.661226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:37.669333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:37.670787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:54:37.684998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:37.687207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:37.688184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 610/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:37.692254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:37.740885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:37.794622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3c94b-1f51-4cec-96d7-3f52ed6dac78 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:37.828200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:37.828802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:37.829080 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:37.829354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:37.830168 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:37.835808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:37.835808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:37.850278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 617/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Oct 3 15:54:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:37.857095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:37.954220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faa1af-89e7-4eb2-a234-c41f98ccbefc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:37.987816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:37.988403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:37.988679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:37.988946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:38.000158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:38.001597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:38.015384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:38.016343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:38.017228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:38.017228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:38.017228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:38.017228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 611/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:38.022295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:38.121954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362d709-c020-4031-a676-db996faa2f98 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:38.124323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:38.156413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:38.157016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:38.157297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:38.157569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:38.158241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:38.158550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:38.159907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:38.171074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 618/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:38.176778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:38.186402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:38.279687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169fab-70e1-4b8f-a752-51105323fc6e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:38.312951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:38.313577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:38.313891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:38.314167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:38.320635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:38.322759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:54:38.333649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:38.334718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:38.335906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 612/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:38.341423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:38.439391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891283b2-8687-486a-9ef5-49186d0a1fdf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:38.473034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3af5e-6d0d-4959-9227-910a11b1a451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:38.473636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3af5e-6d0d-4959-9227-910a11b1a451 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:38.473953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3af5e-6d0d-4959-9227-910a11b1a451 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:38.474235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3af5e-6d0d-4959-9227-910a11b1a451 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:38.474922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3af5e-6d0d-4959-9227-910a11b1a451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:38.475234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3af5e-6d0d-4959-9227-910a11b1a451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:38.476667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3af5e-6d0d-4959-9227-910a11b1a451 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:38.488426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 619/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:38.495336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:38.562977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:38.598342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168bfa1-3fd6-453a-ad97-638b67422e4f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:38.630837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457516a-905c-4b63-9434-259ef32586e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:38.631495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457516a-905c-4b63-9434-259ef32586e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:38.631777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457516a-905c-4b63-9434-259ef32586e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:38.632049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457516a-905c-4b63-9434-259ef32586e7 None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/e33f20c6985d48a0948969182d38ca08/roles/1ff414d138e94c31ac02e205bfabb944` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:38.646951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457516a-905c-4b63-9434-259ef32586e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=e33f20c6985d48a0948969182d38ca08, role_id=1ff414d138e94c31ac02e205bfabb944)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:38.648407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457516a-905c-4b63-9434-259ef32586e7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:38.718587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 613/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:54:38 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/e33f20c6985d48a0948969182d38ca08/roles/1ff414d138e94c31ac02e205bfabb944 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:54:40.928608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb638f-4d0b-4f2b-918e-c22ad3d3298c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:40.929148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb638f-4d0b-4f2b-918e-c22ad3d3298c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:40.929148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb638f-4d0b-4f2b-918e-c22ad3d3298c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:40.930934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 620/1233] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:40.935881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8d744-54e7-43f9-97d0-f3a130c3c7ea None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:40.944077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8d744-54e7-43f9-97d0-f3a130c3c7ea None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:40.944077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8d744-54e7-43f9-97d0-f3a130c3c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:40.954433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9ff8d744-54e7-43f9-97d0-f3a130c3c7ea None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:40.955613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9ff8d744-54e7-43f9-97d0-f3a130c3c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:41.021340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 614/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:54:41.288031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb638f-4d0b-4f2b-918e-c22ad3d3298c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:41.313429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:41.397017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb638f-4d0b-4f2b-918e-c22ad3d3298c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:41.431277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:41.431915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:41.432204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:41.432478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:41.442668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:54:41.447481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:41.448543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:41.449852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 621/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Oct 3 15:54:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:41.455158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8d744-54e7-43f9-97d0-f3a130c3c7ea None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:41.499097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:41.548931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8d744-54e7-43f9-97d0-f3a130c3c7ea None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:41.580844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:41.581440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:41.581717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:41.582026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:41.582674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:41.582973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:41.584314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:41.592536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 615/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Oct 3 15:54:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:41.598380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:41.682274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:41.697666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55f8a-fe3e-4945-8a8c-309134dfe2d7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:41.731890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:41.732352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:41.732638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:41.732925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:41.743002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:41.744470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:41.759234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:41.760368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:41.761400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:41.761400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:41.761400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:41.761400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 622/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:41.766262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:41.866936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74932772-6a9f-4357-83bd-6d9e3c856c44 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:41.875674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:41.900695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:41.901295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:41.901573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:41.905664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:41.905664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:41.905664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:41.905664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:41.915545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 616/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:41.921375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:42.019959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b269c-260a-4352-ac5f-4de3796e0d18 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:42.052228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:42.052839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:42.053118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:42.053389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:42.056206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:42.061166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:42.062612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:54:42.074288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:42.075411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:42.076492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 623/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:42.081273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:42.182154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b024d-c0f4-4cce-9074-cac47fb80fc2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:42.215152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:42.215746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:42.216027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:42.216303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:42.217015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:42.217321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:42.218761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:42.235083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 617/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Oct 3 15:54:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:42.240854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:42.344009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c807da-ca08-4e1f-a0e4-d462d755c36e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:42.377394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:42.378064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:42.378347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:42.378653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:42.442298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:42.449731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:42.451212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:42.553345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 624/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:54:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:54:42.559932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:42.587625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:42.657602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd5af8-f764-45d5-bc88-857b500bd39b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:42.694256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:42.694819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:42.695125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:42.695397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:42.705630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:42.707099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:42.721441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:42.722574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:42.723796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:42.723796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:42.723796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:42.723796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 618/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:42.728831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:42.822367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:42.827973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43a6ba-4678-48a2-a394-d3ab6eb005f4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:42.861087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:42.861682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:42.861991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:42.862263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:42.862891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:42.863195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:42.864549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:42.875985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 625/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:42.881906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:42.963728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:42.984328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7474d-4e31-4cda-a312-671ebbf54c42 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:43.018358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:43.018980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:43.019260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:43.019534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:43.026337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:43.027793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:54:43.039647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:43.040754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:43.041732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 619/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:43.046834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:43.145464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c137dba-168b-4091-bb10-0edbdb8790ac None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:43.177194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214faa8-2169-40ac-9e7c-209f1766e6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:43.177810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214faa8-2169-40ac-9e7c-209f1766e6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:43.178094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214faa8-2169-40ac-9e7c-209f1766e6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:43.178366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214faa8-2169-40ac-9e7c-209f1766e6b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:43.179043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214faa8-2169-40ac-9e7c-209f1766e6b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:43.179346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214faa8-2169-40ac-9e7c-209f1766e6b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:43.181346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214faa8-2169-40ac-9e7c-209f1766e6b9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:43.193446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 626/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:43.200754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:43.298692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c841663-a395-4cdb-b816-9056de841294 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:43.331856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717224b1-bb59-4455-9ac3-a51a51ae1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:43.332492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717224b1-bb59-4455-9ac3-a51a51ae1b1c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:43.332769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717224b1-bb59-4455-9ac3-a51a51ae1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:43.333038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717224b1-bb59-4455-9ac3-a51a51ae1b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:43.333743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717224b1-bb59-4455-9ac3-a51a51ae1b1c None admin] RBAC: Adding query filter params (role.id=1ff414d138e94c31ac02e205bfabb944, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=e33f20c6985d48a0948969182d38ca08) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:43.334108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717224b1-bb59-4455-9ac3-a51a51ae1b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:43.335600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717224b1-bb59-4455-9ac3-a51a51ae1b1c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:43.341712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 620/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:54:43 2022] GET /identity/v3/role_assignments?user.id=e33f20c6985d48a0948969182d38ca08&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=1ff414d138e94c31ac02e205bfabb944 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:45.528822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b892-656c-4a96-9921-3d78042dfba6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:45.529401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b892-656c-4a96-9921-3d78042dfba6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:45.529401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43b892-656c-4a96-9921-3d78042dfba6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:45.530796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 627/1247] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:45.535899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3554-d589-4720-bf39-5790caf3fa8c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:45.536281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3554-d589-4720-bf39-5790caf3fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:45.536442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb3554-d589-4720-bf39-5790caf3fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:45.543105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:45.555243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f5eb3554-d589-4720-bf39-5790caf3fa8c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:45.556457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f5eb3554-d589-4720-bf39-5790caf3fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:45.623005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 621/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:54:45.894681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43b892-656c-4a96-9921-3d78042dfba6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:45.912382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:45.995656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43b892-656c-4a96-9921-3d78042dfba6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:46.028908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:46.029526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:46.029830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:46.030103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:46.039974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:54:46.044737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:46.045896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:46.046952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 628/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:46.051936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb3554-d589-4720-bf39-5790caf3fa8c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:46.155069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb3554-d589-4720-bf39-5790caf3fa8c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:46.185804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:46.190648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:46.191328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:46.191613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:46.191886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:46.192546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:46.192850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:46.194249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:46.202811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 622/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:46.208715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:46.286904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:46.310706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a044a-5581-43d2-b082-fcf16198b7fb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:46.344303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:46.344959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:46.345213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:46.345536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:46.356347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:46.357897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:46.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:46.374584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:46.375488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:46.375488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:46.375488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:46.375488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 629/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:46.380837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:46.479656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d18ce-9eb6-437a-9f56-7101e775b0fb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:46.513236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:46.513865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:46.514150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:46.514424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:46.515068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:46.515375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:46.516729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:46.528681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 623/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:46.534519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:46.640982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90165-b711-4ac2-924d-af28e82b14f7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:46.666033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:46.674611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:46.676006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:46.676301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:46.676583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:46.684969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:46.686463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:54:46.698514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:46.699493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:46.700761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 630/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:46.705431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:46.763571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:46.806373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b179d2-9acb-4b4a-b9f7-1111c2a35180 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:46.839642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:46.840247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:46.840529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:46.840803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:46.841524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:46.841867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:46.843366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:46.861657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 624/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Oct 3 15:54:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:46.867568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:46.981539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f3487-0a89-4993-8b46-9e78aab1a9e2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:47.015156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:47.015687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:47.015965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:47.016235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:47.070800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:47.087211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:47.093741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:47.196592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 631/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:54:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:54:47.202611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:47.300633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539288d-7e33-4545-8c4f-c7193694cb2c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:47.313990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:47.334459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:47.335083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:47.335363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:47.335633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:47.346149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:47.347588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:47.361801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:47.362975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:47.364091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:47.364091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:47.364091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:47.364091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 625/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:47.369515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:47.457085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:47.470782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af6b33-6830-4ae5-8725-f9ab0fca6086 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:47.505005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:47.505609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:47.505920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:47.506192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:47.506814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:47.507113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:47.508497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:47.519221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 632/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:47.525509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:47.622416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885bc71-7ca0-423f-a9ae-acbe513cb4db None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:47.655294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:47.655833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:47.656111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:47.656380 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:47.662756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:47.664183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:54:47.675816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:47.676850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:47.677974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 626/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:54:47.683228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:47.788537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aebaac-cf66-449b-9e61-de26675410df None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:47.821783 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d68e7-b933-432b-9b74-6879dda6ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:47.822393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d68e7-b933-432b-9b74-6879dda6ad60 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:47.822672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d68e7-b933-432b-9b74-6879dda6ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:47.822945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d68e7-b933-432b-9b74-6879dda6ad60 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:47.823622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d68e7-b933-432b-9b74-6879dda6ad60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:47.823929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d68e7-b933-432b-9b74-6879dda6ad60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:47.825349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d68e7-b933-432b-9b74-6879dda6ad60 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:47.837947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 633/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 15:54:47.844018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:47.868726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:47.941069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49807d1a-cd0a-42fe-ba18-4cf476ed4b97 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:47.974980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97012ec2-2ff7-484e-983c-a4c48f213fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:47.975600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012ec2-2ff7-484e-983c-a4c48f213fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:47.975876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012ec2-2ff7-484e-983c-a4c48f213fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:47.976144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97012ec2-2ff7-484e-983c-a4c48f213fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:47.976882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97012ec2-2ff7-484e-983c-a4c48f213fb4 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=e33f20c6985d48a0948969182d38ca08) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:47.977213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97012ec2-2ff7-484e-983c-a4c48f213fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:47.978960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97012ec2-2ff7-484e-983c-a4c48f213fb4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:47.984239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 627/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:54:47 2022] GET /identity/v3/role_assignments?user.id=e33f20c6985d48a0948969182d38ca08&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=722cda8b508d40678af249ff70cb0751 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:50.122022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a6ba-afb3-4063-a0b3-4c14c2361bb7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:50.122533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a6ba-afb3-4063-a0b3-4c14c2361bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:50.124471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a6ba-afb3-4063-a0b3-4c14c2361bb7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:50.124471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 634/1261] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:50.129098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f228c2-7e50-408e-bd06-9058b1bed2d8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:50.129473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f228c2-7e50-408e-bd06-9058b1bed2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:50.129644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f228c2-7e50-408e-bd06-9058b1bed2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:50.150821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-65f228c2-7e50-408e-bd06-9058b1bed2d8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:50.152058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-65f228c2-7e50-408e-bd06-9058b1bed2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:50.218998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 628/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:54:50.513496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6a6ba-afb3-4063-a0b3-4c14c2361bb7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:50.527742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:50.621932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6a6ba-afb3-4063-a0b3-4c14c2361bb7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:50.656135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:50.656767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:50.657052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:50.657331 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:50.668462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:54:50.673298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:50.675637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:50.676667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 635/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:50.680479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f228c2-7e50-408e-bd06-9058b1bed2d8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:50.699342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:50.782160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f228c2-7e50-408e-bd06-9058b1bed2d8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:50.817144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:50.817742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:50.818084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:50.818358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:50.819009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:50.819308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:50.820768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:50.828977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 629/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:50.834794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:50.902480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:50.935101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef4838-8a93-4f96-b124-ca3f1d7b74e3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:50.968912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:50.969523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:50.969825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:50.970116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:50.980145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:50.981596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:50.995084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:50.996253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:50.997390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:50.997390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:50.997390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:50.997390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 636/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:54:51.002119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:51.081544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:51.100660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7fa3-1ec9-49ff-93e3-1f4d25f6abfc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:51.132575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:51.133175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:51.133434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:51.133702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:51.134355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:51.134656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:51.136808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:51.147374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 630/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:51.153194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:51.254709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a2851-21d9-4803-80f6-bad6d519ae3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:51.274376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:51.287826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:51.288442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:51.288718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:51.288986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:51.296504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:51.297966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:54:51.309319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:51.312240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:51.313389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 637/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:51.316412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:51.420328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b621-11f5-4fcd-ae37-531c10e205aa None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:51.453906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:51.454504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:51.454780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:51.455051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:51.455759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:51.456062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:51.457481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:51.466948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:51.474750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 631/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Oct 3 15:54:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:51.481475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:51.580443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab76867-323d-4322-b380-3fd3845bb2ee None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:51.613663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:51.614482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:51.614764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:51.615040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:51.626020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:51.627465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:51.641342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:51.642582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:51.643657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:51.643657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:51.643657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:51.643657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 638/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:51.648279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:51.748324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353035d6-b475-47b8-ab7e-db2fe1458bb0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:51.780495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:51.781089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:51.781389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:51.781668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:51.782328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:51.782633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:51.783999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:51.795362 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 632/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:51.801027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:51.836437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:51.907223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee094d57-8922-4b69-b51f-54212f18bd3c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:51.940582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:51.941202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:51.941480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:51.941749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:51.948968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:51.950450 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:54:51.961488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:51.969325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:51.971356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 639/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:51.972544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:52.032429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:52.073255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85eb88-f058-4437-b263-702c18fec3c5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:52.107992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927eec34-3101-403a-8c35-f92d069d0f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:52.108595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eec34-3101-403a-8c35-f92d069d0f50 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:52.108928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eec34-3101-403a-8c35-f92d069d0f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:52.109208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927eec34-3101-403a-8c35-f92d069d0f50 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:52.109932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eec34-3101-403a-8c35-f92d069d0f50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:52.110243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eec34-3101-403a-8c35-f92d069d0f50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:52.116093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927eec34-3101-403a-8c35-f92d069d0f50 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:52.126744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 633/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:52.132930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:52.227519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:52.236027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f656a-52ce-43bb-b3bb-d7866ca77b5d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:52.270567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48391950-218c-4d37-89d4-a0076e5cc07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:52.271254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391950-218c-4d37-89d4-a0076e5cc07f None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:52.271517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391950-218c-4d37-89d4-a0076e5cc07f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:52.271995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391950-218c-4d37-89d4-a0076e5cc07f None admin] PATH_INFO: `/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/e33f20c6985d48a0948969182d38ca08/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:52.274280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48391950-218c-4d37-89d4-a0076e5cc07f None admin] RBAC: Authorizing `identity:create_grant(project_id=afd4f59da7694f67a1a24afd4ed39eef, user_id=e33f20c6985d48a0948969182d38ca08, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:52.276729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48391950-218c-4d37-89d4-a0076e5cc07f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:52.391826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 640/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Oct 3 15:54:52 2022] PUT /identity/v3/projects/afd4f59da7694f67a1a24afd4ed39eef/users/e33f20c6985d48a0948969182d38ca08/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 15:54:54.639539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f68c-0272-462a-a367-bc8096ebaf46 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:54.640153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f68c-0272-462a-a367-bc8096ebaf46 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:54.640526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f68c-0272-462a-a367-bc8096ebaf46 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:54.641993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 634/1274] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:54.647647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184c9df-f5cc-439b-872f-8b4eef94e23b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:54.648175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184c9df-f5cc-439b-872f-8b4eef94e23b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:54.648267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184c9df-f5cc-439b-872f-8b4eef94e23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:54.667097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6184c9df-f5cc-439b-872f-8b4eef94e23b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:54.668398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6184c9df-f5cc-439b-872f-8b4eef94e23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:54.745290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 641/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 15:54:55.056039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f68c-0272-462a-a367-bc8096ebaf46 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:55.173345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f68c-0272-462a-a367-bc8096ebaf46 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:55.194447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:55.212381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:55.223960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:55.223960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:55.223960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:55.225104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 15:54:55.231451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:55.233804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:55.234986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 635/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Oct 3 15:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 15:54:55.238976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184c9df-f5cc-439b-872f-8b4eef94e23b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:55.322877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:55.341713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184c9df-f5cc-439b-872f-8b4eef94e23b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:55.374585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:55.375178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:55.375461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:55.375737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:55.376396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:55.376700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:55.378106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:55.386471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 642/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Oct 3 15:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:55.392463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:55.491611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e977-981c-49e1-aadd-5c1c9ac9009b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:55.524494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:55.525118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:55.525445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:55.526278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:55.536029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:55.537464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:55.551786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:55.552953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:55.553915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:55.553915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:55.553915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:55.553915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 636/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:55.558843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:55.659435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d97987-e267-4497-b101-eb91e2a3c5ab None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:55.692857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:55.693458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:55.693737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:55.694036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:55.694670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:55.694967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:55.696313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:55.708171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 643/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:55.714220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:55.745431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:55.813369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ac2b1-7813-4bdc-9d7d-c05c0c756baf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:55.847902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:55.848520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:55.848795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:55.849064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:55.855975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:55.857390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 15:54:55.868555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:55.870348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:55.871629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 637/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:55.876136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:55.879908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:55.974424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63bfe-82b4-47b0-82d9-46b48cfcc738 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:56.007385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:56.007977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:56.008254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:56.008522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:56.009225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:56.009525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:56.011064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:56.028053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 644/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Oct 3 15:54:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:56.033873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:56.127361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:56.137014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e83d6-16a7-4386-82aa-61f5269d1443 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:56.170045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:56.171003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:56.171279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:56.171549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:56.235971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:56.237349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:56.320024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:56.330229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 638/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Oct 3 15:54:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 15:54:56.336037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:56.401182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:56.440502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c5f98-74f2-44fb-8438-4ded5d4a2140 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:56.480867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:56.481520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:56.481826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:56.482102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:56.492508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:56.493910 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 15:54:56.507980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:56.509112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 15:54:56.514771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 15:54:56.514771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 15:54:56.514771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:56.514771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 645/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 15:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:56.515058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:56.616828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab097-04f5-4170-bdb3-ccc687f0f2d8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:56.649815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:56.650958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:56.651232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:56.651502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:56.652228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:56.652537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:56.653922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:56.664687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 639/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Oct 3 15:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:56.671089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:56.771726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3475aa-27e4-4116-92b6-f4cac13711a5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:56.785815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:56.805435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:56.806090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:56.806373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:56.806672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:56.813211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:56.814728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 15:54:56.826305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:56.827341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Oct 03 15:54:56.828241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 646/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Oct 3 15:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:56.833430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:56.882130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:56.930721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17ff6a7-8205-4633-b8ff-52f689699207 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:56.964348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3b854-864f-487d-936d-cd0b5b172c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:56.964943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3b854-864f-487d-936d-cd0b5b172c6a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:56.965230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3b854-864f-487d-936d-cd0b5b172c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:56.965499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3b854-864f-487d-936d-cd0b5b172c6a None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:56.966207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3b854-864f-487d-936d-cd0b5b172c6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:56.966515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3b854-864f-487d-936d-cd0b5b172c6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:56.967943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3b854-864f-487d-936d-cd0b5b172c6a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:56.980344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 640/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Oct 3 15:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:56.986510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:57.084505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a2a2d-43bb-4c33-9df6-4fbe5afb57ca None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:57.117934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475e222-c8e8-4f14-805e-c302716c5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:57.118527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e222-c8e8-4f14-805e-c302716c5524 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:57.118811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e222-c8e8-4f14-805e-c302716c5524 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:57.119606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475e222-c8e8-4f14-805e-c302716c5524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:57.120328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475e222-c8e8-4f14-805e-c302716c5524 None admin] RBAC: Adding query filter params (role.id=722cda8b508d40678af249ff70cb0751, scope.project.id=afd4f59da7694f67a1a24afd4ed39eef, user.id=e33f20c6985d48a0948969182d38ca08) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:57.120641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475e222-c8e8-4f14-805e-c302716c5524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:57.122096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475e222-c8e8-4f14-805e-c302716c5524 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:57.127754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 647/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Oct 3 15:54:56 2022] GET /identity/v3/role_assignments?user.id=e33f20c6985d48a0948969182d38ca08&scope.project.id=afd4f59da7694f67a1a24afd4ed39eef&role.id=722cda8b508d40678af249ff70cb0751 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:59.272891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbec86-a9e9-4e03-aae9-4a77479f9627 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:59.273448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbec86-a9e9-4e03-aae9-4a77479f9627 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:59.273569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbec86-a9e9-4e03-aae9-4a77479f9627 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:59.274849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 641/1288] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:54:59.279989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48ba3-ab57-4a9d-834c-ada5d406991f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:59.280408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48ba3-ab57-4a9d-834c-ada5d406991f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:59.280571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48ba3-ab57-4a9d-834c-ada5d406991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:59.299065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-88a48ba3-ab57-4a9d-834c-ada5d406991f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:54:59.300279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-88a48ba3-ab57-4a9d-834c-ada5d406991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:54:59.329498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:59.367130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 648/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:54:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:54:59.633175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbec86-a9e9-4e03-aae9-4a77479f9627 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:59.733690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbec86-a9e9-4e03-aae9-4a77479f9627 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:59.744284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:54:59.767324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:59.767948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:59.768224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:59.768528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:59.769103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:59.770497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:54:59.779597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:54:59.786501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:54:59.787367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 642/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:54:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:54:59.788192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48ba3-ab57-4a9d-834c-ada5d406991f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:54:59.886376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a48ba3-ab57-4a9d-834c-ada5d406991f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:54:59.920567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e7539-235e-4387-aed9-edd51ece724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:54:59.921167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e7539-235e-4387-aed9-edd51ece724e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:54:59.921447 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e7539-235e-4387-aed9-edd51ece724e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:54:59.921719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e7539-235e-4387-aed9-edd51ece724e None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:54:59.922377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e7539-235e-4387-aed9-edd51ece724e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:54:59.922680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e7539-235e-4387-aed9-edd51ece724e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:54:59.924047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e7539-235e-4387-aed9-edd51ece724e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:54:59.928790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 649/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Oct 3 15:54:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:54:59.935257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:00.033365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c73562-f431-4d5c-94e7-90e0a705befd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:00.066947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ab6e7-0738-4ec2-abe8-db88b0e25a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:00.067548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab6e7-0738-4ec2-abe8-db88b0e25a9c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:00.067831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab6e7-0738-4ec2-abe8-db88b0e25a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:00.068108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab6e7-0738-4ec2-abe8-db88b0e25a9c None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:00.068730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab6e7-0738-4ec2-abe8-db88b0e25a9c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:55:00.069036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab6e7-0738-4ec2-abe8-db88b0e25a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:00.070434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab6e7-0738-4ec2-abe8-db88b0e25a9c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:00.074810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 643/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Oct 3 15:54:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:55:02.215488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010bb7a-df32-4de3-a9fc-be40035423f6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:02.216023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010bb7a-df32-4de3-a9fc-be40035423f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:02.216023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010bb7a-df32-4de3-a9fc-be40035423f6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:02.217487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 650/1293] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:55:02.222878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a5a29-0d58-4036-afaa-1001f05b7de8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:02.223314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a5a29-0d58-4036-afaa-1001f05b7de8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:02.223463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a5a29-0d58-4036-afaa-1001f05b7de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:02.242575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cf7a5a29-0d58-4036-afaa-1001f05b7de8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:55:02.243763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cf7a5a29-0d58-4036-afaa-1001f05b7de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:55:02.273331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:02.309477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 644/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:55:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:55:02.582668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010bb7a-df32-4de3-a9fc-be40035423f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:02.614340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:02.685893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010bb7a-df32-4de3-a9fc-be40035423f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:02.720918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bcd52-f8a2-4a3b-a06f-096704359e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:02.721521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bcd52-f8a2-4a3b-a06f-096704359e15 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:02.721821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bcd52-f8a2-4a3b-a06f-096704359e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:02.722095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bcd52-f8a2-4a3b-a06f-096704359e15 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:02.722770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bcd52-f8a2-4a3b-a06f-096704359e15 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:02.724126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bcd52-f8a2-4a3b-a06f-096704359e15 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:02.798784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 651/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Oct 3 15:55:02 2022] POST /identity/v3/services => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 15:55:05.010869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e75f8-961a-4b3f-903c-f48dc9a0e8c8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:05.011392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e75f8-961a-4b3f-903c-f48dc9a0e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:05.011392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e75f8-961a-4b3f-903c-f48dc9a0e8c8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:05.012779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 645/1296] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:55:05.017983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9311ed4-47d4-4a56-a043-364131582655 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:05.018426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9311ed4-47d4-4a56-a043-364131582655 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:05.018563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9311ed4-47d4-4a56-a043-364131582655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:05.036507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e9311ed4-47d4-4a56-a043-364131582655 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:55:05.037680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e9311ed4-47d4-4a56-a043-364131582655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:55:05.112128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 652/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:55:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:55:05.382026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e75f8-961a-4b3f-903c-f48dc9a0e8c8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:05.480560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e75f8-961a-4b3f-903c-f48dc9a0e8c8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:05.514093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:05.514707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:05.514985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:05.515287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:05.515854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:05.517246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:55:05.525751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:55:05.526957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:55:05.527998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 646/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:55:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:55:05.532848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9311ed4-47d4-4a56-a043-364131582655 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:05.550876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:05.628491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9311ed4-47d4-4a56-a043-364131582655 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:05.662675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:05.663211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:05.663494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:05.663768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:05.664389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:55:05.664693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:05.666230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:05.671194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 653/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Oct 3 15:55:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:55:05.677076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:05.713050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:05.783713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55637f-3d32-4113-ac23-4ef119c8d93c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:05.817826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4706e69-022f-43ae-811c-01fbcb11f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:05.818431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706e69-022f-43ae-811c-01fbcb11f159 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:05.818712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706e69-022f-43ae-811c-01fbcb11f159 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:05.818986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4706e69-022f-43ae-811c-01fbcb11f159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:05.819682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706e69-022f-43ae-811c-01fbcb11f159 None admin] RBAC: Adding query filter params (interface=public, service_id=c744b67e80c4415b8c4ad4e8a34a2e9e, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:55:05.819994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706e69-022f-43ae-811c-01fbcb11f159 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:05.821349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4706e69-022f-43ae-811c-01fbcb11f159 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:05.826414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 647/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Oct 3 15:55:05 2022] GET /identity/v3/endpoints?service_id=c744b67e80c4415b8c4ad4e8a34a2e9e&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:55:05.832181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:05.911831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:05.930840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ede60-f3b1-4fd2-8911-04b234a59c15 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:05.963163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c148c31-df4b-4bfa-9c81-5dfbc87434a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:05.963760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148c31-df4b-4bfa-9c81-5dfbc87434a8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:05.964053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148c31-df4b-4bfa-9c81-5dfbc87434a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:05.964308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c148c31-df4b-4bfa-9c81-5dfbc87434a8 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:05.964899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148c31-df4b-4bfa-9c81-5dfbc87434a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:05.966285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c148c31-df4b-4bfa-9c81-5dfbc87434a8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:05.972840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 654/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Oct 3 15:55:05 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 15:55:08.153423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004b090-5f15-4a7e-af41-6dc93b8be7b9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:08.153993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004b090-5f15-4a7e-af41-6dc93b8be7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:08.154098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004b090-5f15-4a7e-af41-6dc93b8be7b9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:08.155383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 648/1302] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 15:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 15:55:08.160642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ef8e-3772-4a24-a860-88783100e30e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:08.161025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ef8e-3772-4a24-a860-88783100e30e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:08.161201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0ef8e-3772-4a24-a860-88783100e30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:08.180241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-eea0ef8e-3772-4a24-a860-88783100e30e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 15:55:08.182111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-eea0ef8e-3772-4a24-a860-88783100e30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 15:55:08.248394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 655/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 15:55:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 15:55:08.518045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004b090-5f15-4a7e-af41-6dc93b8be7b9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:08.611375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:08.617824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004b090-5f15-4a7e-af41-6dc93b8be7b9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:08.650365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:08.650988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:08.651263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:08.651535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:08.652112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:08.653468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 15:55:08.662672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 15:55:08.663655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Oct 03 15:55:08.665261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 649/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Oct 3 15:55:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 15:55:08.670317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ef8e-3772-4a24-a860-88783100e30e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:08.749053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:08.770965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0ef8e-3772-4a24-a860-88783100e30e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:08.804969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597fc2b-dafd-4838-b8ee-faf81368f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:08.805564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597fc2b-dafd-4838-b8ee-faf81368f7ae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:08.805870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597fc2b-dafd-4838-b8ee-faf81368f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:08.806145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597fc2b-dafd-4838-b8ee-faf81368f7ae None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:08.807336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597fc2b-dafd-4838-b8ee-faf81368f7ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 15:55:08.807641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597fc2b-dafd-4838-b8ee-faf81368f7ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:08.808997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597fc2b-dafd-4838-b8ee-faf81368f7ae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:08.813844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 656/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Oct 3 15:55:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 15:55:08.819680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 15:55:08.918516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af8adf-8455-493a-b0c7-dc508eb7c713 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 15:55:08.950914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793d2ba-c170-4d0f-aa8c-5f54e784ce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 15:55:08.951534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793d2ba-c170-4d0f-aa8c-5f54e784ce2c None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 15:55:08.951812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793d2ba-c170-4d0f-aa8c-5f54e784ce2c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 15:55:08.952084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793d2ba-c170-4d0f-aa8c-5f54e784ce2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 15:55:08.952753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793d2ba-c170-4d0f-aa8c-5f54e784ce2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 15:55:08.954136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793d2ba-c170-4d0f-aa8c-5f54e784ce2c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 15:55:09.050054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 650/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 15:55:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 15:55:18.821482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=30 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 15:55:19.045455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:51.534083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92fef-d423-4dff-bd0b-bf36da7ecb78 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:51.534524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92fef-d423-4dff-bd0b-bf36da7ecb78 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:51.534601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b92fef-d423-4dff-bd0b-bf36da7ecb78 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:51.541123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91a90-082d-4ddb-9a51-a343357fc055 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:51.541535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91a90-082d-4ddb-9a51-a343357fc055 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:51.541675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91a90-082d-4ddb-9a51-a343357fc055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:51.544477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 657/1307] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:00:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:00:51.690469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-48d91a90-082d-4ddb-9a51-a343357fc055 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:00:51.692693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-48d91a90-082d-4ddb-9a51-a343357fc055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:51.846898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 651/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:00:52.156131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682fd92-49bc-495b-99d6-ff5723b3bd70 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:52.156464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682fd92-49bc-495b-99d6-ff5723b3bd70 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:52.157074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682fd92-49bc-495b-99d6-ff5723b3bd70 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:52.160096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 658/1309] 10.222.0.26 () {54 vars in 964 bytes} [Mon Oct 3 16:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:00:52.171683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0474f-87b9-4993-a38a-f49b47ec7224 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:52.173902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0474f-87b9-4993-a38a-f49b47ec7224 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:52.173902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0474f-87b9-4993-a38a-f49b47ec7224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:52.266383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2ac0474f-87b9-4993-a38a-f49b47ec7224 None None] MFA Rules not processed for user `bf531e7741af49f091e1116ec1c6751c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:00:52.267660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2ac0474f-87b9-4993-a38a-f49b47ec7224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:52.292635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:52.374753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682fd92-49bc-495b-99d6-ff5723b3bd70 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:00:52.376523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4682fd92-49bc-495b-99d6-ff5723b3bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:52.379696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 652/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Oct 3 16:00:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:00:52.498549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682fd92-49bc-495b-99d6-ff5723b3bd70 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:00:52.584102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3592a9-6865-4fbd-a300-046919374e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:00:52.584749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3592a9-6865-4fbd-a300-046919374e46 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:52.585149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3592a9-6865-4fbd-a300-046919374e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:52.585506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3592a9-6865-4fbd-a300-046919374e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:52.588002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e3592a9-6865-4fbd-a300-046919374e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:52.648244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:52.714058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3592a9-6865-4fbd-a300-046919374e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:00:52.715980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3592a9-6865-4fbd-a300-046919374e46 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:00:52.739130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 659/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:00:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:00:55.249854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980f22-d9e2-48a1-b71e-dfc71aabaddb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:55.250383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980f22-d9e2-48a1-b71e-dfc71aabaddb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:55.250383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980f22-d9e2-48a1-b71e-dfc71aabaddb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:55.251644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 653/1312] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:00:55.256872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e80b9-dbba-4932-a639-d98405e461f3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:55.257249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e80b9-dbba-4932-a639-d98405e461f3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:55.257422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e80b9-dbba-4932-a639-d98405e461f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:55.329269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-490e80b9-dbba-4932-a639-d98405e461f3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:00:55.330497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-490e80b9-dbba-4932-a639-d98405e461f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:55.430613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 660/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:00:55.713816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac980f22-d9e2-48a1-b71e-dfc71aabaddb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:00:55.715611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ac980f22-d9e2-48a1-b71e-dfc71aabaddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:55.818879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac980f22-d9e2-48a1-b71e-dfc71aabaddb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:00:55.889597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:55.891876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8c079-a9c7-4801-b0b2-8287acb4b450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:00:55.892476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8c079-a9c7-4801-b0b2-8287acb4b450 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:55.892753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8c079-a9c7-4801-b0b2-8287acb4b450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:55.893023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8c079-a9c7-4801-b0b2-8287acb4b450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:55.894638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ffa8c079-a9c7-4801-b0b2-8287acb4b450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:56.005545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8c079-a9c7-4801-b0b2-8287acb4b450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:00:56.006936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8c079-a9c7-4801-b0b2-8287acb4b450 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:00:56.025704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 654/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:00:58.662040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7d02-ee18-41c6-8955-0ba295176022 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:58.662588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7d02-ee18-41c6-8955-0ba295176022 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:58.662687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7d02-ee18-41c6-8955-0ba295176022 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:58.663964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 661/1315] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:00:58.670032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc481c2-a769-41da-82c7-a8b280403843 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:58.670467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc481c2-a769-41da-82c7-a8b280403843 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:58.670588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc481c2-a769-41da-82c7-a8b280403843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:58.737258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-adc481c2-a769-41da-82c7-a8b280403843 None None] MFA Rules not processed for user `3799900f832343e982b92b4fa868b5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:00:58.738510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-adc481c2-a769-41da-82c7-a8b280403843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:58.790739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:58.834698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 655/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:00:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:00:59.122908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a7d02-ee18-41c6-8955-0ba295176022 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:00:59.124452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bc2a7d02-ee18-41c6-8955-0ba295176022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:59.134401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:59.227833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a7d02-ee18-41c6-8955-0ba295176022 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:00:59.302182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f274a2-ca9f-4bb5-ac21-2c6c33e71395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:00:59.302704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f274a2-ca9f-4bb5-ac21-2c6c33e71395 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:00:59.302985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f274a2-ca9f-4bb5-ac21-2c6c33e71395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:00:59.303259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f274a2-ca9f-4bb5-ac21-2c6c33e71395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:00:59.304849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-44f274a2-ca9f-4bb5-ac21-2c6c33e71395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:00:59.374213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:00:59.422921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f274a2-ca9f-4bb5-ac21-2c6c33e71395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:00:59.424366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f274a2-ca9f-4bb5-ac21-2c6c33e71395 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:00:59.442345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 662/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:00:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:02.371566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d816-3663-4c21-8f00-535f4965e91b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:02.372178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d816-3663-4c21-8f00-535f4965e91b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:02.372178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d816-3663-4c21-8f00-535f4965e91b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:02.373559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 656/1318] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:02.378901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181d985-0712-4b1b-b3ef-da3e6e654e8c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:02.379336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181d985-0712-4b1b-b3ef-da3e6e654e8c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:02.379461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181d985-0712-4b1b-b3ef-da3e6e654e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:02.444919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b181d985-0712-4b1b-b3ef-da3e6e654e8c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:02.446684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b181d985-0712-4b1b-b3ef-da3e6e654e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:02.542349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 663/1319] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:02.829076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d816-3663-4c21-8f00-535f4965e91b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:02.830628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-aaf2d816-3663-4c21-8f00-535f4965e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:02.934348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d816-3663-4c21-8f00-535f4965e91b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:03.008783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb260ea-c32c-4890-b659-aa6dbe1a6d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:03.010753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb260ea-c32c-4890-b659-aa6dbe1a6d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:03.010753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb260ea-c32c-4890-b659-aa6dbe1a6d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:03.010753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb260ea-c32c-4890-b659-aa6dbe1a6d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:03.011485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4eb260ea-c32c-4890-b659-aa6dbe1a6d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:03.019125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:03.118366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb260ea-c32c-4890-b659-aa6dbe1a6d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:03.119778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb260ea-c32c-4890-b659-aa6dbe1a6d53 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:03.137568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 657/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:06.441587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51791e-ff1c-4196-bdd3-564ca016d475 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:06.442179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51791e-ff1c-4196-bdd3-564ca016d475 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:06.442179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51791e-ff1c-4196-bdd3-564ca016d475 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:06.443566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 664/1321] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:06.449115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84bba5-85b8-4348-9be8-b0a5b90d10df None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:06.449571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84bba5-85b8-4348-9be8-b0a5b90d10df None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:06.449668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84bba5-85b8-4348-9be8-b0a5b90d10df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:06.520618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bd84bba5-85b8-4348-9be8-b0a5b90d10df None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:06.521878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bd84bba5-85b8-4348-9be8-b0a5b90d10df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:06.590215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:06.632460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 658/1322] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:06.923890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51791e-ff1c-4196-bdd3-564ca016d475 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:06.925465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8e51791e-ff1c-4196-bdd3-564ca016d475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:06.945946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:07.033306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51791e-ff1c-4196-bdd3-564ca016d475 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:07.108035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9146baf-875f-46fa-b725-1d53e6e37137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:07.108637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9146baf-875f-46fa-b725-1d53e6e37137 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:07.108918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9146baf-875f-46fa-b725-1d53e6e37137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:07.109193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9146baf-875f-46fa-b725-1d53e6e37137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:07.110817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d9146baf-875f-46fa-b725-1d53e6e37137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:07.183972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:07.222650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9146baf-875f-46fa-b725-1d53e6e37137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:07.224091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9146baf-875f-46fa-b725-1d53e6e37137 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:07.241891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 665/1323] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:09.455973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f174c-c223-434d-94f6-8efd65dbe72c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:09.456533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f174c-c223-434d-94f6-8efd65dbe72c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:09.456533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f174c-c223-434d-94f6-8efd65dbe72c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:09.457916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 659/1324] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:09.464375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082632c-4f62-40dd-aae8-92b2847ca178 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:09.465038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082632c-4f62-40dd-aae8-92b2847ca178 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:09.465186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082632c-4f62-40dd-aae8-92b2847ca178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:09.532518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c082632c-4f62-40dd-aae8-92b2847ca178 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:09.533727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c082632c-4f62-40dd-aae8-92b2847ca178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:09.635709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 666/1325] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:09.917754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f174c-c223-434d-94f6-8efd65dbe72c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:09.919426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-901f174c-c223-434d-94f6-8efd65dbe72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:10.025936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f174c-c223-434d-94f6-8efd65dbe72c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:10.101241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd3900-b921-40ef-89f8-f2d2017165ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:10.102002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3900-b921-40ef-89f8-f2d2017165ca service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:10.102290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3900-b921-40ef-89f8-f2d2017165ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:10.102563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd3900-b921-40ef-89f8-f2d2017165ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:10.104154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-65fd3900-b921-40ef-89f8-f2d2017165ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:10.121419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:10.213950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd3900-b921-40ef-89f8-f2d2017165ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:10.215576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd3900-b921-40ef-89f8-f2d2017165ca service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:10.233473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 660/1326] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:12.449610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e8f4-6d3a-4c07-beca-d668d91c7c51 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:12.450159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e8f4-6d3a-4c07-beca-d668d91c7c51 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:12.450254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76e8f4-6d3a-4c07-beca-d668d91c7c51 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:12.451514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 667/1327] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:12.456930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92acdb-513b-4635-b085-e097adebe1f6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:12.457325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92acdb-513b-4635-b085-e097adebe1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:12.457466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92acdb-513b-4635-b085-e097adebe1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:12.525950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4a92acdb-513b-4635-b085-e097adebe1f6 None None] MFA Rules not processed for user `3799900f832343e982b92b4fa868b5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:12.527153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4a92acdb-513b-4635-b085-e097adebe1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:12.592949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:12.623794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 661/1328] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:12.917070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87554-a071-46a0-8227-4e5a9954f818 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:12.917355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87554-a071-46a0-8227-4e5a9954f818 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:12.917642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87554-a071-46a0-8227-4e5a9954f818 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:12.919187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 668/1329] 10.222.0.26 () {54 vars in 964 bytes} [Mon Oct 3 16:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:12.925377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f57e4d-e020-4f16-966c-05ff59612533 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:12.925661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f57e4d-e020-4f16-966c-05ff59612533 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:12.925967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f57e4d-e020-4f16-966c-05ff59612533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:13.010023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-14f57e4d-e020-4f16-966c-05ff59612533 None None] MFA Rules not processed for user `bf531e7741af49f091e1116ec1c6751c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:13.011317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-14f57e4d-e020-4f16-966c-05ff59612533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:13.230447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 662/1330] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Oct 3 16:01:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:13.239120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87554-a071-46a0-8227-4e5a9954f818 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:13.240659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c0a87554-a071-46a0-8227-4e5a9954f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:13.276139 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:13.358342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87554-a071-46a0-8227-4e5a9954f818 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:13.439508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d912-8b70-42cd-a3b3-558977be3e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:13.440047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d912-8b70-42cd-a3b3-558977be3e48 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:13.440424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d912-8b70-42cd-a3b3-558977be3e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:13.440709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d912-8b70-42cd-a3b3-558977be3e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:13.442798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2a11d912-8b70-42cd-a3b3-558977be3e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:13.532419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:13.565906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d912-8b70-42cd-a3b3-558977be3e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:13.567357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d912-8b70-42cd-a3b3-558977be3e48 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:13.586821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 669/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:13 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:16.532992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85c99-dca1-40f8-be83-4a68622c6adb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:16.533634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85c99-dca1-40f8-be83-4a68622c6adb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:16.533634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a85c99-dca1-40f8-be83-4a68622c6adb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:16.534893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 663/1332] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:16.540041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a534-abca-41a4-80fe-7c30025ec169 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:16.540471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a534-abca-41a4-80fe-7c30025ec169 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:16.540581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a534-abca-41a4-80fe-7c30025ec169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:16.605211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1ad2a534-abca-41a4-80fe-7c30025ec169 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:16.606425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1ad2a534-abca-41a4-80fe-7c30025ec169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:16.699913 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 670/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:16.985505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a85c99-dca1-40f8-be83-4a68622c6adb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:16.987110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-08a85c99-dca1-40f8-be83-4a68622c6adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:17.056173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:17.089477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a85c99-dca1-40f8-be83-4a68622c6adb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:17.160977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a8355-96d3-4197-8344-b1adacca12fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:17.161572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a8355-96d3-4197-8344-b1adacca12fe service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:17.161874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a8355-96d3-4197-8344-b1adacca12fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:17.162142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a8355-96d3-4197-8344-b1adacca12fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:17.163702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6d7a8355-96d3-4197-8344-b1adacca12fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:17.270064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a8355-96d3-4197-8344-b1adacca12fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:17.271408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a8355-96d3-4197-8344-b1adacca12fe service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:17.280971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:17.289639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 664/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:19.462938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aad0c-2799-4947-a2d7-8de9dda3af4a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:19.463478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aad0c-2799-4947-a2d7-8de9dda3af4a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:19.463478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aad0c-2799-4947-a2d7-8de9dda3af4a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:19.465081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 671/1335] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:19.470253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df894-0eec-4e3f-8d04-f3fec0ef3e67 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:19.470703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df894-0eec-4e3f-8d04-f3fec0ef3e67 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:19.470799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817df894-0eec-4e3f-8d04-f3fec0ef3e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:19.537285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-817df894-0eec-4e3f-8d04-f3fec0ef3e67 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:19.538526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-817df894-0eec-4e3f-8d04-f3fec0ef3e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:19.633116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 665/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:19.931693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aad0c-2799-4947-a2d7-8de9dda3af4a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:19.933259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a42aad0c-2799-4947-a2d7-8de9dda3af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:19.973525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:20.036147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aad0c-2799-4947-a2d7-8de9dda3af4a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:20.108107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7da05-b7a1-4410-983f-792ee74b7dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:20.108703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7da05-b7a1-4410-983f-792ee74b7dbe service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:20.108980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7da05-b7a1-4410-983f-792ee74b7dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:20.109249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7da05-b7a1-4410-983f-792ee74b7dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:20.110849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bfa7da05-b7a1-4410-983f-792ee74b7dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:20.190856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:20.217229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7da05-b7a1-4410-983f-792ee74b7dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:20.218706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7da05-b7a1-4410-983f-792ee74b7dbe service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:20.236804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 672/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:22.941993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc6163-1bd6-4c54-a9e5-decd1f7f09db None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:22.942526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc6163-1bd6-4c54-a9e5-decd1f7f09db None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:22.942526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc6163-1bd6-4c54-a9e5-decd1f7f09db None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:22.944007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 666/1338] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:22.949982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574d01-994a-4579-8aaf-09f5c8b2ad1a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:22.950439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574d01-994a-4579-8aaf-09f5c8b2ad1a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:22.950541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27574d01-994a-4579-8aaf-09f5c8b2ad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:23.016467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-27574d01-994a-4579-8aaf-09f5c8b2ad1a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:23.017656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-27574d01-994a-4579-8aaf-09f5c8b2ad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:23.112939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 673/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:23.395991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc6163-1bd6-4c54-a9e5-decd1f7f09db None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:23.397577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-44cc6163-1bd6-4c54-a9e5-decd1f7f09db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:23.479399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:23.507563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc6163-1bd6-4c54-a9e5-decd1f7f09db None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:23.581338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ec47c-ffee-4261-bc6c-371ecf0ff67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:23.581887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ec47c-ffee-4261-bc6c-371ecf0ff67f service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:23.582168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ec47c-ffee-4261-bc6c-371ecf0ff67f service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:23.582440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ec47c-ffee-4261-bc6c-371ecf0ff67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:23.584009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7f3ec47c-ffee-4261-bc6c-371ecf0ff67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:23.692186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ec47c-ffee-4261-bc6c-371ecf0ff67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:23.693601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ec47c-ffee-4261-bc6c-371ecf0ff67f service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:23.711710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 667/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:28.091754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c750e-dd58-4966-8124-d730d69a1dba None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:28.092284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c750e-dd58-4966-8124-d730d69a1dba None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:28.092284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c750e-dd58-4966-8124-d730d69a1dba None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:28.093663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 674/1341] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:28.098982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b041d-0673-427e-bc83-38791054feb5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:28.099398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b041d-0673-427e-bc83-38791054feb5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:28.099531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b041d-0673-427e-bc83-38791054feb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:28.105853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:28.167698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7d6b041d-0673-427e-bc83-38791054feb5 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:28.168912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7d6b041d-0673-427e-bc83-38791054feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:28.265386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 668/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:28.554839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c750e-dd58-4966-8124-d730d69a1dba None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:28.556473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e35c750e-dd58-4966-8124-d730d69a1dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:28.607328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:28.664112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c750e-dd58-4966-8124-d730d69a1dba None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:28.742778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e339bb-b124-435c-8a7e-00f0537776b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:28.743392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e339bb-b124-435c-8a7e-00f0537776b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:28.743674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e339bb-b124-435c-8a7e-00f0537776b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:28.743976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e339bb-b124-435c-8a7e-00f0537776b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:28.745571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-41e339bb-b124-435c-8a7e-00f0537776b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:28.844361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:28.862516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e339bb-b124-435c-8a7e-00f0537776b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:28.864020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e339bb-b124-435c-8a7e-00f0537776b2 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:28.883958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 675/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:32.056621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384317f-6659-4ccc-a33a-a0a199b5c7e4 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:32.057173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384317f-6659-4ccc-a33a-a0a199b5c7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:32.057173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384317f-6659-4ccc-a33a-a0a199b5c7e4 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:32.058585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 669/1344] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:32.064457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121164-406a-495b-ada8-e0021f395520 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:32.065032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121164-406a-495b-ada8-e0021f395520 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:32.065032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c121164-406a-495b-ada8-e0021f395520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:32.133526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6c121164-406a-495b-ada8-e0021f395520 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:32.134763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c121164-406a-495b-ada8-e0021f395520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:32.237304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 676/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:32.527677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384317f-6659-4ccc-a33a-a0a199b5c7e4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:32.529226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d384317f-6659-4ccc-a33a-a0a199b5c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:32.617368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:32.633911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384317f-6659-4ccc-a33a-a0a199b5c7e4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:32.708214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1c552-ee23-4fc7-804a-5f3568b950c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:32.708818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1c552-ee23-4fc7-804a-5f3568b950c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:32.709096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1c552-ee23-4fc7-804a-5f3568b950c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:32.709367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1c552-ee23-4fc7-804a-5f3568b950c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:32.711247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2cc1c552-ee23-4fc7-804a-5f3568b950c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:32.845880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1c552-ee23-4fc7-804a-5f3568b950c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:32.847339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1c552-ee23-4fc7-804a-5f3568b950c8 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:32.867498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 670/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:37.310191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9458a9-6892-417c-b120-fe731d04215d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:37.310622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9458a9-6892-417c-b120-fe731d04215d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:37.310732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9458a9-6892-417c-b120-fe731d04215d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:37.312068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 677/1347] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:37.317531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a989965-23b3-41ca-83cb-7ce5926c74e1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:37.325501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a989965-23b3-41ca-83cb-7ce5926c74e1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:37.325501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a989965-23b3-41ca-83cb-7ce5926c74e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:37.333954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:37.398573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4a989965-23b3-41ca-83cb-7ce5926c74e1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:37.399825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4a989965-23b3-41ca-83cb-7ce5926c74e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:37.507498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 671/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:37.812010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9458a9-6892-417c-b120-fe731d04215d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:37.812010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ba9458a9-6892-417c-b120-fe731d04215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:37.868397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:37.913828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9458a9-6892-417c-b120-fe731d04215d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:37.988966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717dc50-42ab-46a2-a0da-0af01c33fce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:37.989574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717dc50-42ab-46a2-a0da-0af01c33fce6 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:37.989890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717dc50-42ab-46a2-a0da-0af01c33fce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:37.990194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717dc50-42ab-46a2-a0da-0af01c33fce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:37.992377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c717dc50-42ab-46a2-a0da-0af01c33fce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:38.098106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:38.101163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717dc50-42ab-46a2-a0da-0af01c33fce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:38.102632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717dc50-42ab-46a2-a0da-0af01c33fce6 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:38.120949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 678/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:43.067366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bfc8e-10c4-4ddc-b1bc-a7a7187b5e72 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:43.067816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bfc8e-10c4-4ddc-b1bc-a7a7187b5e72 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:43.067897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bfc8e-10c4-4ddc-b1bc-a7a7187b5e72 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:43.069348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 672/1350] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:43.076522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab88a-3d88-4396-a820-5783150d43d0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:43.076956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab88a-3d88-4396-a820-5783150d43d0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:43.077256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ab88a-3d88-4396-a820-5783150d43d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:43.202302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9e6ab88a-3d88-4396-a820-5783150d43d0 None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:43.203771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9e6ab88a-3d88-4396-a820-5783150d43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:43.359763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 679/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:01:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:47.471596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ce92-91e6-46f0-94c9-9e7fc8bb10a2 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:47.472142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ce92-91e6-46f0-94c9-9e7fc8bb10a2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:47.472142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867ce92-91e6-46f0-94c9-9e7fc8bb10a2 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:47.473715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 673/1352] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:47.479737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552287a-1a57-451d-bef3-37ce744db658 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:47.480200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552287a-1a57-451d-bef3-37ce744db658 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:47.480282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552287a-1a57-451d-bef3-37ce744db658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:47.505484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=59 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:47.541598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:47.566241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7552287a-1a57-451d-bef3-37ce744db658 None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:47.567535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7552287a-1a57-451d-bef3-37ce744db658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:47.700709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 680/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:01:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:49.228576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66729f3-247d-4af2-aa9f-cbfcb59182f0 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:49.229112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66729f3-247d-4af2-aa9f-cbfcb59182f0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:49.229112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66729f3-247d-4af2-aa9f-cbfcb59182f0 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:49.230514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 674/1354] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 16:01:49.235633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9cf5-c1f9-4f05-8edd-5f80f2ad8c93 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:49.236079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9cf5-c1f9-4f05-8edd-5f80f2ad8c93 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:49.236242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e9cf5-c1f9-4f05-8edd-5f80f2ad8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:49.312366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9e0e9cf5-c1f9-4f05-8edd-5f80f2ad8c93 None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:49.313486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9e0e9cf5-c1f9-4f05-8edd-5f80f2ad8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:49.356314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:49.426721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 681/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:01:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:52.953978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63ce9-a598-4416-a06b-e128acec5a09 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:52.954502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63ce9-a598-4416-a06b-e128acec5a09 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:52.954502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63ce9-a598-4416-a06b-e128acec5a09 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:52.955749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 675/1356] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:52.961308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d4aa-86ce-4b7c-a6ad-3498fe5edd2a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:52.962150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d4aa-86ce-4b7c-a6ad-3498fe5edd2a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:52.962430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186d4aa-86ce-4b7c-a6ad-3498fe5edd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:53.036876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7186d4aa-86ce-4b7c-a6ad-3498fe5edd2a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:53.037910 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7186d4aa-86ce-4b7c-a6ad-3498fe5edd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:53.140323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 682/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:53.448969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0eaac-8b91-45dd-8452-21c2f85321a4 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:53.450715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0eaac-8b91-45dd-8452-21c2f85321a4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:53.455187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0eaac-8b91-45dd-8452-21c2f85321a4 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:53.455187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 676/1358] 10.222.0.26 () {54 vars in 961 bytes} [Mon Oct 3 16:01:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:53.462505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf95b13-88b1-43c5-a4f7-223d3479bf85 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:53.462753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf95b13-88b1-43c5-a4f7-223d3479bf85 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:53.463039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf95b13-88b1-43c5-a4f7-223d3479bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:53.480322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:53.665463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3cf95b13-88b1-43c5-a4f7-223d3479bf85 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:53.666834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3cf95b13-88b1-43c5-a4f7-223d3479bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:53.797698 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 683/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Oct 3 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:53.806316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0eaac-8b91-45dd-8452-21c2f85321a4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:53.808095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b0f0eaac-8b91-45dd-8452-21c2f85321a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:53.976953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0eaac-8b91-45dd-8452-21c2f85321a4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:54.062955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:54.110330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71836447-fa86-443d-963b-6a02b7973af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:54.111232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836447-fa86-443d-963b-6a02b7973af1 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:54.111519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836447-fa86-443d-963b-6a02b7973af1 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:54.111798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71836447-fa86-443d-963b-6a02b7973af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:54.113456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-71836447-fa86-443d-963b-6a02b7973af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:54.211498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836447-fa86-443d-963b-6a02b7973af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:54.213109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71836447-fa86-443d-963b-6a02b7973af1 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:54.232371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 677/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:01:56.619327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac71a5-f38f-4cd2-a8cd-2bbdac560b73 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:56.619813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac71a5-f38f-4cd2-a8cd-2bbdac560b73 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:56.619908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac71a5-f38f-4cd2-a8cd-2bbdac560b73 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:56.621191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 684/1361] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:01:56.626797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b5dd-2a7c-4748-ba8e-bfbe73a74272 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:56.627215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b5dd-2a7c-4748-ba8e-bfbe73a74272 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:56.627493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b5dd-2a7c-4748-ba8e-bfbe73a74272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:56.696312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5fb8b5dd-2a7c-4748-ba8e-bfbe73a74272 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:01:56.697632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5fb8b5dd-2a7c-4748-ba8e-bfbe73a74272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:56.737934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:56.799966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 678/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:01:57.095005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac71a5-f38f-4cd2-a8cd-2bbdac560b73 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:01:57.097079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-11ac71a5-f38f-4cd2-a8cd-2bbdac560b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:57.179991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:57.279799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac71a5-f38f-4cd2-a8cd-2bbdac560b73 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:01:57.398754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818318ba-62a5-4da0-a5b5-31c67f371a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:01:57.399361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818318ba-62a5-4da0-a5b5-31c67f371a7c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:01:57.399661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818318ba-62a5-4da0-a5b5-31c67f371a7c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:01:57.399936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818318ba-62a5-4da0-a5b5-31c67f371a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:01:57.401519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-818318ba-62a5-4da0-a5b5-31c67f371a7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:01:57.426829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:01:57.498043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818318ba-62a5-4da0-a5b5-31c67f371a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:01:57.499638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818318ba-62a5-4da0-a5b5-31c67f371a7c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:01:57.518362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 685/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:00.185677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350238-9e0d-4a0c-b37b-9ae8147c46ec None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:00.186251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350238-9e0d-4a0c-b37b-9ae8147c46ec None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:00.186251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350238-9e0d-4a0c-b37b-9ae8147c46ec None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:00.187834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 679/1364] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:00.192840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08715-9266-4960-9a66-82b9d210ce5e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:00.193237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08715-9266-4960-9a66-82b9d210ce5e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:00.193406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da08715-9266-4960-9a66-82b9d210ce5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:00.263418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9da08715-9266-4960-9a66-82b9d210ce5e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:00.264607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9da08715-9266-4960-9a66-82b9d210ce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:00.370563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:00.378076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 686/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:00.663542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ec60-1d52-4eaa-82e8-c42557a9d551 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:00.663828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ec60-1d52-4eaa-82e8-c42557a9d551 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:00.664093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1ec60-1d52-4eaa-82e8-c42557a9d551 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:00.665556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 680/1366] 10.222.0.26 () {54 vars in 961 bytes} [Mon Oct 3 16:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:00.671072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3fab-e63d-427e-9071-3bc8e8f16fb8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:00.671462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3fab-e63d-427e-9071-3bc8e8f16fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:00.671838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3fab-e63d-427e-9071-3bc8e8f16fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:00.764257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7d6d3fab-e63d-427e-9071-3bc8e8f16fb8 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:00.765624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7d6d3fab-e63d-427e-9071-3bc8e8f16fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:00.908813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 687/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Oct 3 16:02:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:00.918236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ec60-1d52-4eaa-82e8-c42557a9d551 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:00.919963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6af1ec60-1d52-4eaa-82e8-c42557a9d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:01.077871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1ec60-1d52-4eaa-82e8-c42557a9d551 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:01.104435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:01.210201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f1380-da6a-4ed9-b086-c4c83f8e9078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:01.210922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f1380-da6a-4ed9-b086-c4c83f8e9078 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:01.211026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f1380-da6a-4ed9-b086-c4c83f8e9078 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:01.211282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f1380-da6a-4ed9-b086-c4c83f8e9078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:01.212868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-291f1380-da6a-4ed9-b086-c4c83f8e9078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:01.213307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb439a6a-0742-4cb9-96fc-078a2442f749 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:01.213679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb439a6a-0742-4cb9-96fc-078a2442f749 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:01.213898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb439a6a-0742-4cb9-96fc-078a2442f749 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:01.215716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 688/1368] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:01.220599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939061-05ff-48ca-b76f-a28773c3a0d2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:01.220880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939061-05ff-48ca-b76f-a28773c3a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:01.221151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939061-05ff-48ca-b76f-a28773c3a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:01.292514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:01.300995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-60939061-05ff-48ca-b76f-a28773c3a0d2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:01.307379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-60939061-05ff-48ca-b76f-a28773c3a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:01.317250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f1380-da6a-4ed9-b086-c4c83f8e9078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:01.319512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f1380-da6a-4ed9-b086-c4c83f8e9078 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:01.341050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 681/1369] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:01.409270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 689/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:02:01.765290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed33427-746a-4d8f-8829-de9afe305948 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:01.765290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed33427-746a-4d8f-8829-de9afe305948 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:01.765290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed33427-746a-4d8f-8829-de9afe305948 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:01.766033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 682/1371] 10.222.0.26 () {54 vars in 963 bytes} [Mon Oct 3 16:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:01.771116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc954-b923-4705-8fd2-213571d7b575 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:01.771403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc954-b923-4705-8fd2-213571d7b575 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:01.772361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dc954-b923-4705-8fd2-213571d7b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:01.864733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-398dc954-b923-4705-8fd2-213571d7b575 None None] MFA Rules not processed for user `8869c7baa4124705bcb3a8c835f566a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:01.872602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-398dc954-b923-4705-8fd2-213571d7b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:01.942635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:01.951788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 690/1372] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Oct 3 16:02:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:01.959894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed33427-746a-4d8f-8829-de9afe305948 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:01.961524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9ed33427-746a-4d8f-8829-de9afe305948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:01.994109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:02.080588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed33427-746a-4d8f-8829-de9afe305948 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:02.164734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5009975-fe8d-4715-a398-f55975685283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:02.164734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5009975-fe8d-4715-a398-f55975685283 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:02.164734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5009975-fe8d-4715-a398-f55975685283 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:02.164734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5009975-fe8d-4715-a398-f55975685283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:02.165244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b5009975-fe8d-4715-a398-f55975685283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:02.256964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:02.295710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5009975-fe8d-4715-a398-f55975685283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:02.297501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5009975-fe8d-4715-a398-f55975685283 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:02.323052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 683/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:02:03.717936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249cac3-7238-4226-bbb2-111fbfb227e5 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:03.718527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249cac3-7238-4226-bbb2-111fbfb227e5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:03.718527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249cac3-7238-4226-bbb2-111fbfb227e5 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:03.719694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 691/1374] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:03.725823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45d82-1a01-4e01-910d-ef8ea2d23bd5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:03.726402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45d82-1a01-4e01-910d-ef8ea2d23bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:03.726402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f45d82-1a01-4e01-910d-ef8ea2d23bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:03.792294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-68f45d82-1a01-4e01-910d-ef8ea2d23bd5 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:03.793490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-68f45d82-1a01-4e01-910d-ef8ea2d23bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:03.897346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 684/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:04.200501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249cac3-7238-4226-bbb2-111fbfb227e5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:04.202054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e249cac3-7238-4226-bbb2-111fbfb227e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:04.357540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249cac3-7238-4226-bbb2-111fbfb227e5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:04.429338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:04.487335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36504d5e-6635-403b-a3ff-0387b6a28969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:04.487954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504d5e-6635-403b-a3ff-0387b6a28969 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:04.488230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504d5e-6635-403b-a3ff-0387b6a28969 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:04.488522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504d5e-6635-403b-a3ff-0387b6a28969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:04.490246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-36504d5e-6635-403b-a3ff-0387b6a28969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:04.612040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36504d5e-6635-403b-a3ff-0387b6a28969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:04.614074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36504d5e-6635-403b-a3ff-0387b6a28969 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:04.638708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 692/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:07.119696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eee6a7-1d35-4db6-aaee-7033372d2931 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:07.121011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eee6a7-1d35-4db6-aaee-7033372d2931 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:07.121458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eee6a7-1d35-4db6-aaee-7033372d2931 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:07.123022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 685/1377] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:07.128533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851c4f-c39b-4fe8-bad8-73d4070c2172 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:07.128971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851c4f-c39b-4fe8-bad8-73d4070c2172 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:07.129157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e851c4f-c39b-4fe8-bad8-73d4070c2172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:07.196655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7e851c4f-c39b-4fe8-bad8-73d4070c2172 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:07.197915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7e851c4f-c39b-4fe8-bad8-73d4070c2172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:07.229058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:07.308405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 693/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:07.604422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eee6a7-1d35-4db6-aaee-7033372d2931 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:07.605968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-88eee6a7-1d35-4db6-aaee-7033372d2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:07.643760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:07.765985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eee6a7-1d35-4db6-aaee-7033372d2931 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:07.893731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:07.899150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec64a-163e-4022-a130-1fbf0f8d2a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:07.899754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec64a-163e-4022-a130-1fbf0f8d2a1e service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:07.900034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec64a-163e-4022-a130-1fbf0f8d2a1e service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:07.900302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec64a-163e-4022-a130-1fbf0f8d2a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:07.902208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f8fec64a-163e-4022-a130-1fbf0f8d2a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:08.002443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec64a-163e-4022-a130-1fbf0f8d2a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:08.004099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fec64a-163e-4022-a130-1fbf0f8d2a1e service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:08.024465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 686/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:10.403891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963518f-d891-4ac8-bedc-331f9daca3f5 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:10.404442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963518f-d891-4ac8-bedc-331f9daca3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:10.404442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963518f-d891-4ac8-bedc-331f9daca3f5 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:10.405925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 694/1380] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:10.411679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76a19-53ce-4c91-8cd0-16db76b5527b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:10.412255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76a19-53ce-4c91-8cd0-16db76b5527b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:10.412433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76a19-53ce-4c91-8cd0-16db76b5527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:10.483462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e0e76a19-53ce-4c91-8cd0-16db76b5527b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:10.484988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e0e76a19-53ce-4c91-8cd0-16db76b5527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:10.558718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:10.596980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 687/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:10.889438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963518f-d891-4ac8-bedc-331f9daca3f5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:10.891556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d963518f-d891-4ac8-bedc-331f9daca3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:11.051928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963518f-d891-4ac8-bedc-331f9daca3f5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:11.065468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:11.175893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237186e-f3ad-4924-98f7-baa5040fdb23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:11.176419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237186e-f3ad-4924-98f7-baa5040fdb23 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:11.176695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237186e-f3ad-4924-98f7-baa5040fdb23 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:11.176962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237186e-f3ad-4924-98f7-baa5040fdb23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:11.178629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b237186e-f3ad-4924-98f7-baa5040fdb23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:11.269782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237186e-f3ad-4924-98f7-baa5040fdb23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:11.271940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237186e-f3ad-4924-98f7-baa5040fdb23 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:11.290169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 695/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:13.652901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069fbc4-eb02-4b24-ac0c-299ab6552851 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:13.653755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069fbc4-eb02-4b24-ac0c-299ab6552851 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:13.653755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069fbc4-eb02-4b24-ac0c-299ab6552851 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:13.654799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 688/1383] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:13.661489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e56ae-7431-4b75-baa4-494bac5163d5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:13.662637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e56ae-7431-4b75-baa4-494bac5163d5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:13.663413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e56ae-7431-4b75-baa4-494bac5163d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:13.705159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:13.754385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3e2e56ae-7431-4b75-baa4-494bac5163d5 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:13.755603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3e2e56ae-7431-4b75-baa4-494bac5163d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:13.902676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 696/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:14.276078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069fbc4-eb02-4b24-ac0c-299ab6552851 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:14.278154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d069fbc4-eb02-4b24-ac0c-299ab6552851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:14.457434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069fbc4-eb02-4b24-ac0c-299ab6552851 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:14.512135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:14.582474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae67fd-7106-47f2-8296-e55aa244f102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:14.583529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae67fd-7106-47f2-8296-e55aa244f102 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:14.584981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae67fd-7106-47f2-8296-e55aa244f102 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:14.585407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae67fd-7106-47f2-8296-e55aa244f102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:14.587552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-73ae67fd-7106-47f2-8296-e55aa244f102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:14.697844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae67fd-7106-47f2-8296-e55aa244f102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:14.699987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae67fd-7106-47f2-8296-e55aa244f102 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:14.723834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 689/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:17.011386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5dbd3-9cd6-4202-b740-74aece84ee75 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:17.011894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5dbd3-9cd6-4202-b740-74aece84ee75 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:17.011894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5dbd3-9cd6-4202-b740-74aece84ee75 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:17.013198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 697/1386] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:17.018670 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff461e25-954b-4da2-b9ec-52375948e934 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:17.019084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff461e25-954b-4da2-b9ec-52375948e934 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:17.019229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff461e25-954b-4da2-b9ec-52375948e934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:17.090749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ff461e25-954b-4da2-b9ec-52375948e934 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:17.091956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ff461e25-954b-4da2-b9ec-52375948e934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:17.100434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:17.190245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 690/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:17.482026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5dbd3-9cd6-4202-b740-74aece84ee75 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:17.483609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-55c5dbd3-9cd6-4202-b740-74aece84ee75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:17.576986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:17.633223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5dbd3-9cd6-4202-b740-74aece84ee75 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:17.747707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90184823-ba1c-4d30-939b-b8c3278a5c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:17.748345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184823-ba1c-4d30-939b-b8c3278a5c47 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:17.748620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184823-ba1c-4d30-939b-b8c3278a5c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:17.748885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184823-ba1c-4d30-939b-b8c3278a5c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:17.750489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-90184823-ba1c-4d30-939b-b8c3278a5c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:17.809988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:17.841924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184823-ba1c-4d30-939b-b8c3278a5c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:17.843513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184823-ba1c-4d30-939b-b8c3278a5c47 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:17.861702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 698/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:18.379936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f17e3-7545-49af-9d42-a4db1eeef56d None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:18.381326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f17e3-7545-49af-9d42-a4db1eeef56d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:18.381326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f17e3-7545-49af-9d42-a4db1eeef56d None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:18.383085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 691/1389] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:18.388537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acaf36-07ac-4751-a2ea-3333bbab90d1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:18.388964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acaf36-07ac-4751-a2ea-3333bbab90d1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:18.389115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acaf36-07ac-4751-a2ea-3333bbab90d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:18.457235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-68acaf36-07ac-4751-a2ea-3333bbab90d1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:18.458466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-68acaf36-07ac-4751-a2ea-3333bbab90d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:18.563787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 699/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:18.870276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7a78a-3856-478a-9496-2e5260f48870 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:18.870555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7a78a-3856-478a-9496-2e5260f48870 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:18.870828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7a78a-3856-478a-9496-2e5260f48870 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:18.872174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 692/1391] 10.222.0.26 () {54 vars in 962 bytes} [Mon Oct 3 16:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:18.877320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ced79e-e572-4c67-a6f3-d7f78e71ec97 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:18.877684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ced79e-e572-4c67-a6f3-d7f78e71ec97 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:18.877994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ced79e-e572-4c67-a6f3-d7f78e71ec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:18.927204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:18.961641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b8ced79e-e572-4c67-a6f3-d7f78e71ec97 None None] MFA Rules not processed for user `31f9685c8b244249b2d29f4612a3e5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:18.962892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b8ced79e-e572-4c67-a6f3-d7f78e71ec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:19.041306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 700/1392] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Oct 3 16:02:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:19.047349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7a78a-3856-478a-9496-2e5260f48870 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:19.048855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c5c7a78a-3856-478a-9496-2e5260f48870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:19.161559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7a78a-3856-478a-9496-2e5260f48870 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:19.199944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:19.237156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd73c8-de9e-48fc-8642-92078c1b0ad3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9685c8b244249b2d29f4612a3e5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:19.237788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd73c8-de9e-48fc-8642-92078c1b0ad3 service glance] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:19.238066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd73c8-de9e-48fc-8642-92078c1b0ad3 service glance] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:19.238340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd73c8-de9e-48fc-8642-92078c1b0ad3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:19.240067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e6bd73c8-de9e-48fc-8642-92078c1b0ad3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:19.350125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd73c8-de9e-48fc-8642-92078c1b0ad3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:19.351501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd73c8-de9e-48fc-8642-92078c1b0ad3 service glance] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:19.370291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 693/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:02:20.214495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb8ef0-8907-4b8b-9ebc-e4f657389541 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:20.215075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb8ef0-8907-4b8b-9ebc-e4f657389541 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:20.215075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb8ef0-8907-4b8b-9ebc-e4f657389541 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:20.216734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 701/1394] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:20.222048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cb30-3b5b-4b5e-aa05-431f0345eae7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:20.222472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cb30-3b5b-4b5e-aa05-431f0345eae7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:20.222639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cb30-3b5b-4b5e-aa05-431f0345eae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:20.291653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bf0af-26a6-454c-95b0-ad58509e9531 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:20.291939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bf0af-26a6-454c-95b0-ad58509e9531 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:20.292244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bf0af-26a6-454c-95b0-ad58509e9531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:20.293860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-da75cb30-3b5b-4b5e-aa05-431f0345eae7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:20.295065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-da75cb30-3b5b-4b5e-aa05-431f0345eae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:20.314280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:20.359751 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0f2bf0af-26a6-454c-95b0-ad58509e9531 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:20.360963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0f2bf0af-26a6-454c-95b0-ad58509e9531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:20.395598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 694/1395] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:20.447071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:20.454487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 702/1396] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:02:20.501463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644164f-fa15-4f9a-8637-60e52e12bfa3 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:20.501750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644164f-fa15-4f9a-8637-60e52e12bfa3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:20.502056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644164f-fa15-4f9a-8637-60e52e12bfa3 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:20.503717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 695/1397] 10.222.0.26 () {54 vars in 943 bytes} [Mon Oct 3 16:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:20.510615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cea27-d98c-4e09-8ed6-f6c46b742cc2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:20.510904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cea27-d98c-4e09-8ed6-f6c46b742cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:20.511183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cea27-d98c-4e09-8ed6-f6c46b742cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:20.591745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-131cea27-d98c-4e09-8ed6-f6c46b742cc2 None None] MFA Rules not processed for user `a21de1ac06b8422fa33aae8a1ad4bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:20.592919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-131cea27-d98c-4e09-8ed6-f6c46b742cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:20.691394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644164f-fa15-4f9a-8637-60e52e12bfa3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:20.693508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d644164f-fa15-4f9a-8637-60e52e12bfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:20.703605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 703/1398] 10.222.0.26 () {58 vars in 1040 bytes} [Mon Oct 3 16:02:20 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:02:20.713328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cea27-d98c-4e09-8ed6-f6c46b742cc2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:20.723927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cea27-d98c-4e09-8ed6-f6c46b742cc2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:20.776742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:20.833468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687a47c-5017-4032-afa8-fda234eb4d03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:20.834261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687a47c-5017-4032-afa8-fda234eb4d03 service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:20.834536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687a47c-5017-4032-afa8-fda234eb4d03 service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:20.834808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687a47c-5017-4032-afa8-fda234eb4d03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:20.836429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a687a47c-5017-4032-afa8-fda234eb4d03 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:20.849900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644164f-fa15-4f9a-8637-60e52e12bfa3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:20.852719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:20.926899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687a47c-5017-4032-afa8-fda234eb4d03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:20.929264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687a47c-5017-4032-afa8-fda234eb4d03 service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:20.937686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 704/1399] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:02:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:02:20.973468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6a164-95d6-43c2-9db2-ba6c40656b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:20.975316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a164-95d6-43c2-9db2-ba6c40656b08 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:20.975462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a164-95d6-43c2-9db2-ba6c40656b08 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:20.975651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6a164-95d6-43c2-9db2-ba6c40656b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:20.977254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3bc6a164-95d6-43c2-9db2-ba6c40656b08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:21.069972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a164-95d6-43c2-9db2-ba6c40656b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:21.071500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6a164-95d6-43c2-9db2-ba6c40656b08 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:21.089489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 696/1400] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:23.448829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab7751-15b4-4c8a-bb8c-29991f056d3e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:23.449313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab7751-15b4-4c8a-bb8c-29991f056d3e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:23.449601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab7751-15b4-4c8a-bb8c-29991f056d3e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:23.451516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 705/1401] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:23.456614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828e9a-e9b7-4c2c-9daa-d668adb12c69 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:23.457029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828e9a-e9b7-4c2c-9daa-d668adb12c69 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:23.457159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828e9a-e9b7-4c2c-9daa-d668adb12c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:23.468620 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:23.533136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-31828e9a-e9b7-4c2c-9daa-d668adb12c69 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:23.534405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-31828e9a-e9b7-4c2c-9daa-d668adb12c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:23.648532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 697/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:23.949345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab7751-15b4-4c8a-bb8c-29991f056d3e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:23.950968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-51ab7751-15b4-4c8a-bb8c-29991f056d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:24.047794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:24.130325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab7751-15b4-4c8a-bb8c-29991f056d3e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:24.308086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23c5a6-87ac-4351-b1fc-84cca84a9c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:24.308086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c5a6-87ac-4351-b1fc-84cca84a9c09 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:24.308086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c5a6-87ac-4351-b1fc-84cca84a9c09 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:24.308086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c5a6-87ac-4351-b1fc-84cca84a9c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:24.308795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9f23c5a6-87ac-4351-b1fc-84cca84a9c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:24.399678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23c5a6-87ac-4351-b1fc-84cca84a9c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:24.401416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23c5a6-87ac-4351-b1fc-84cca84a9c09 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:24.429027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 706/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:24.625365 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:27.321057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524bea-6c89-425a-9371-eb72a7a123d9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:27.321604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524bea-6c89-425a-9371-eb72a7a123d9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:27.321604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e524bea-6c89-425a-9371-eb72a7a123d9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:27.323273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 698/1404] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:27.328409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1209c-0ac8-4c34-8325-cb419659c6be None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:27.328855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1209c-0ac8-4c34-8325-cb419659c6be None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:27.328987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1209c-0ac8-4c34-8325-cb419659c6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:27.410344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-aaa1209c-0ac8-4c34-8325-cb419659c6be None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:27.411745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aaa1209c-0ac8-4c34-8325-cb419659c6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:27.519852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 707/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:27.822975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e524bea-6c89-425a-9371-eb72a7a123d9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:27.824503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3e524bea-6c89-425a-9371-eb72a7a123d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:27.919874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:27.987739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e524bea-6c89-425a-9371-eb72a7a123d9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:28.120356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a286597-c11a-411e-b24f-b30c4a7c2aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:28.121095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286597-c11a-411e-b24f-b30c4a7c2aaa service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:28.121422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286597-c11a-411e-b24f-b30c4a7c2aaa service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:28.121704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a286597-c11a-411e-b24f-b30c4a7c2aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:28.123334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7a286597-c11a-411e-b24f-b30c4a7c2aaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:28.180337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:28.225658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286597-c11a-411e-b24f-b30c4a7c2aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:28.227431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a286597-c11a-411e-b24f-b30c4a7c2aaa service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:28.261665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 699/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:30.644814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011981-f294-4c68-8e80-6a3493fd5665 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:30.645359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011981-f294-4c68-8e80-6a3493fd5665 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:30.645359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011981-f294-4c68-8e80-6a3493fd5665 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:30.647163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 708/1407] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:30.652274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117bdd-27d9-4411-8f3f-4e105b54b86d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:30.652700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117bdd-27d9-4411-8f3f-4e105b54b86d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:30.652954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117bdd-27d9-4411-8f3f-4e105b54b86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:30.729816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-65117bdd-27d9-4411-8f3f-4e105b54b86d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:30.730946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-65117bdd-27d9-4411-8f3f-4e105b54b86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:30.840149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 700/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:31.134035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36011981-f294-4c68-8e80-6a3493fd5665 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:31.135563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-36011981-f294-4c68-8e80-6a3493fd5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:31.157990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:31.299384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36011981-f294-4c68-8e80-6a3493fd5665 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:31.404386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:31.432762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f6d8-a40f-4f32-a246-c0759c5df2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:31.433380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f6d8-a40f-4f32-a246-c0759c5df2ee service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:31.433662 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f6d8-a40f-4f32-a246-c0759c5df2ee service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:31.433983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f6d8-a40f-4f32-a246-c0759c5df2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:31.435628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-05c1f6d8-a40f-4f32-a246-c0759c5df2ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:31.531976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f6d8-a40f-4f32-a246-c0759c5df2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:31.533564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f6d8-a40f-4f32-a246-c0759c5df2ee service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:31.557831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 709/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:40.838196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:41.551059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=54 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:45.469540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c45a-4446-44f1-b00b-15bae3e73643 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:45.470122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c45a-4446-44f1-b00b-15bae3e73643 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:45.470122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448c45a-4446-44f1-b00b-15bae3e73643 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:45.471549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 701/1410] 10.222.0.26 () {54 vars in 918 bytes} [Mon Oct 3 16:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:45.477183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60fb5c-0282-408c-9ae4-3e07aaaf69be None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:45.477579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60fb5c-0282-408c-9ae4-3e07aaaf69be None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:45.477728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60fb5c-0282-408c-9ae4-3e07aaaf69be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:45.552278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5b60fb5c-0282-408c-9ae4-3e07aaaf69be None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:45.553479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5b60fb5c-0282-408c-9ae4-3e07aaaf69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:45.659192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 710/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 3 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:45.673596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0ea9-d171-41ef-bbd8-c3e6e6ee6514 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:45.673947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0ea9-d171-41ef-bbd8-c3e6e6ee6514 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:45.674224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0ea9-d171-41ef-bbd8-c3e6e6ee6514 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:45.675553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 702/1412] 10.222.0.26 () {54 vars in 918 bytes} [Mon Oct 3 16:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:45.680479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77861-00da-4711-a7fd-2c1f1d425cba None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:45.680768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77861-00da-4711-a7fd-2c1f1d425cba None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:45.681046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c77861-00da-4711-a7fd-2c1f1d425cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:45.757071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:45.759679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-71c77861-00da-4711-a7fd-2c1f1d425cba None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:45.760898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-71c77861-00da-4711-a7fd-2c1f1d425cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:45.877334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 711/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Oct 3 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:48.526015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec6a17-e082-4a53-97bc-2c3646329969 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:48.526631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec6a17-e082-4a53-97bc-2c3646329969 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:48.526631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec6a17-e082-4a53-97bc-2c3646329969 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:48.527891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:48.533135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133a43-1b32-4eb4-9ca8-4b0130c84b5c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:48.533575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133a43-1b32-4eb4-9ca8-4b0130c84b5c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:48.533804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133a43-1b32-4eb4-9ca8-4b0130c84b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:48.600707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f2133a43-1b32-4eb4-9ca8-4b0130c84b5c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:48.601944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f2133a43-1b32-4eb4-9ca8-4b0130c84b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:48.658417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:48.700361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:48.995947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec6a17-e082-4a53-97bc-2c3646329969 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:48.997449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d3ec6a17-e082-4a53-97bc-2c3646329969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:49.147045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec6a17-e082-4a53-97bc-2c3646329969 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:49.223928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:49.265091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c4378-fffb-4490-8c69-569f71dc09de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:49.265629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c4378-fffb-4490-8c69-569f71dc09de service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:49.265939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c4378-fffb-4490-8c69-569f71dc09de service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:49.266220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c4378-fffb-4490-8c69-569f71dc09de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:49.267797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-153c4378-fffb-4490-8c69-569f71dc09de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:49.358312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c4378-fffb-4490-8c69-569f71dc09de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:49.359890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c4378-fffb-4490-8c69-569f71dc09de service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:49.377213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 704/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:50.531349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50b3aa-bef5-4150-8408-c29455622aae None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:50.531982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50b3aa-bef5-4150-8408-c29455622aae None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:50.531982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50b3aa-bef5-4150-8408-c29455622aae None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:50.533244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 16:02:50.539966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6421e3-b83d-4d90-a705-f090a1eeb664 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:50.540431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6421e3-b83d-4d90-a705-f090a1eeb664 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:50.540540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6421e3-b83d-4d90-a705-f090a1eeb664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:50.618743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2a6421e3-b83d-4d90-a705-f090a1eeb664 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:50.619868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2a6421e3-b83d-4d90-a705-f090a1eeb664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:50.646174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:50.717177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:50.869126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50b3aa-bef5-4150-8408-c29455622aae None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:50.870577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cb50b3aa-bef5-4150-8408-c29455622aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:51.014052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50b3aa-bef5-4150-8408-c29455622aae None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:51.054699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:51.126456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68630362-1cce-4a34-9c7e-aa0f7cde614e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:51.126984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68630362-1cce-4a34-9c7e-aa0f7cde614e service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:51.127297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68630362-1cce-4a34-9c7e-aa0f7cde614e service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:51.127569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68630362-1cce-4a34-9c7e-aa0f7cde614e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:51.129188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-68630362-1cce-4a34-9c7e-aa0f7cde614e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:51.216943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68630362-1cce-4a34-9c7e-aa0f7cde614e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:51.218555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68630362-1cce-4a34-9c7e-aa0f7cde614e service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:51.236423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 714/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:52.397427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743732c-4650-47fc-bc7d-6123379c2934 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:52.398031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743732c-4650-47fc-bc7d-6123379c2934 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:52.398031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743732c-4650-47fc-bc7d-6123379c2934 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:52.399368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:52.405916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc554e3b-d1ec-4051-8cd6-2e50928b87ef None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:52.406357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc554e3b-d1ec-4051-8cd6-2e50928b87ef None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:52.406493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc554e3b-d1ec-4051-8cd6-2e50928b87ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:52.466783 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:52.490417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dc554e3b-d1ec-4051-8cd6-2e50928b87ef None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:52.491626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dc554e3b-d1ec-4051-8cd6-2e50928b87ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:52.588161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:52.738670 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743732c-4650-47fc-bc7d-6123379c2934 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:52.740840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0743732c-4650-47fc-bc7d-6123379c2934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:52.886195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743732c-4650-47fc-bc7d-6123379c2934 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:52.898631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:53.000128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e751c-bbfc-49b1-9472-1bb05ac9970d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:53.000656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e751c-bbfc-49b1-9472-1bb05ac9970d service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:53.000936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e751c-bbfc-49b1-9472-1bb05ac9970d service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:53.001206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e751c-bbfc-49b1-9472-1bb05ac9970d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:53.002827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5d2e751c-bbfc-49b1-9472-1bb05ac9970d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:53.094657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e751c-bbfc-49b1-9472-1bb05ac9970d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:53.096241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e751c-bbfc-49b1-9472-1bb05ac9970d service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:53.114896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 707/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:54.234113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627ef8c-9edb-4ebc-a1b0-988931444e4d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:54.234691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627ef8c-9edb-4ebc-a1b0-988931444e4d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:54.234691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627ef8c-9edb-4ebc-a1b0-988931444e4d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:54.236042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:54.242171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2c80-605b-4f26-b8b9-c0b8182c8da1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:54.242596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2c80-605b-4f26-b8b9-c0b8182c8da1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:54.242704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2c80-605b-4f26-b8b9-c0b8182c8da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:54.263036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:54.318846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2caf2c80-605b-4f26-b8b9-c0b8182c8da1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:54.320054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2caf2c80-605b-4f26-b8b9-c0b8182c8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:54.415339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:54.569902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627ef8c-9edb-4ebc-a1b0-988931444e4d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:54.571366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f627ef8c-9edb-4ebc-a1b0-988931444e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:54.680807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:54.716314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627ef8c-9edb-4ebc-a1b0-988931444e4d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:54.829032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4b856-2646-4378-97cc-6220f15d53a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:54.829568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4b856-2646-4378-97cc-6220f15d53a7 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:54.829880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4b856-2646-4378-97cc-6220f15d53a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:54.830159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4b856-2646-4378-97cc-6220f15d53a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:54.831755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-73b4b856-2646-4378-97cc-6220f15d53a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:54.908695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:54.923028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4b856-2646-4378-97cc-6220f15d53a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:54.924682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4b856-2646-4378-97cc-6220f15d53a7 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:54.942955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 717/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:56.057550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9024c-5481-4466-8f27-6a9ed9a9a4ed None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:56.058112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9024c-5481-4466-8f27-6a9ed9a9a4ed None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:56.058112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9024c-5481-4466-8f27-6a9ed9a9a4ed None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:56.059392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:56.065684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773658-a2a8-4cf4-af08-ed2c79bc1d9d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:56.066132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773658-a2a8-4cf4-af08-ed2c79bc1d9d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:56.066273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62773658-a2a8-4cf4-af08-ed2c79bc1d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:56.143658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-62773658-a2a8-4cf4-af08-ed2c79bc1d9d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:56.144857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-62773658-a2a8-4cf4-af08-ed2c79bc1d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:56.241494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:56.393708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9024c-5481-4466-8f27-6a9ed9a9a4ed None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:56.395365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d4f9024c-5481-4466-8f27-6a9ed9a9a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:56.478420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:56.540420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9024c-5481-4466-8f27-6a9ed9a9a4ed None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:56.654925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182abf1f-a932-45b2-8ebf-d4a84f5e6b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:56.655444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abf1f-a932-45b2-8ebf-d4a84f5e6b47 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:56.655724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abf1f-a932-45b2-8ebf-d4a84f5e6b47 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:56.655996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abf1f-a932-45b2-8ebf-d4a84f5e6b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:56.657582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-182abf1f-a932-45b2-8ebf-d4a84f5e6b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:56.705781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:56.747784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182abf1f-a932-45b2-8ebf-d4a84f5e6b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:56.749387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182abf1f-a932-45b2-8ebf-d4a84f5e6b47 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:56.766893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 710/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:57.877855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f247c-dce2-4b3d-90e6-a5c90521d88e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:57.878431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f247c-dce2-4b3d-90e6-a5c90521d88e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:57.878431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f247c-dce2-4b3d-90e6-a5c90521d88e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:57.879811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:57.886108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baaf1c-e027-4c66-9f12-52018bd985fc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:57.886530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baaf1c-e027-4c66-9f12-52018bd985fc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:57.886658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baaf1c-e027-4c66-9f12-52018bd985fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:57.962285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d3baaf1c-e027-4c66-9f12-52018bd985fc None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:57.963468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d3baaf1c-e027-4c66-9f12-52018bd985fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:58.058825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:02:58.211842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f247c-dce2-4b3d-90e6-a5c90521d88e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:02:58.213341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-051f247c-dce2-4b3d-90e6-a5c90521d88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:58.262186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:58.358360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f247c-dce2-4b3d-90e6-a5c90521d88e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:02:58.471491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725dc0a-af24-4c14-a40c-cede0b0d2bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:02:58.472095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725dc0a-af24-4c14-a40c-cede0b0d2bca service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:58.472371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725dc0a-af24-4c14-a40c-cede0b0d2bca service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:58.472641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725dc0a-af24-4c14-a40c-cede0b0d2bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:58.474767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4725dc0a-af24-4c14-a40c-cede0b0d2bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:58.481556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:58.564683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725dc0a-af24-4c14-a40c-cede0b0d2bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:02:58.566322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725dc0a-af24-4c14-a40c-cede0b0d2bca service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:02:58.585330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 720/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:02:59.757969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b3fa-a6f3-4208-9389-e0f15de3feb0 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:59.758458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b3fa-a6f3-4208-9389-e0f15de3feb0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:59.758565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b3fa-a6f3-4208-9389-e0f15de3feb0 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:59.759917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:02:59.766135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b614-c766-428e-bc45-a49cbae86a7f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:02:59.766563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b614-c766-428e-bc45-a49cbae86a7f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:02:59.766683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361b614-c766-428e-bc45-a49cbae86a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:02:59.845976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6361b614-c766-428e-bc45-a49cbae86a7f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:02:59.847164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6361b614-c766-428e-bc45-a49cbae86a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:02:59.913410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:02:59.941095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:00.094654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b3fa-a6f3-4208-9389-e0f15de3feb0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:00.096088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c272b3fa-a6f3-4208-9389-e0f15de3feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:00.113379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:00.240443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b3fa-a6f3-4208-9389-e0f15de3feb0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:00.328896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:00.355316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5c25a-f058-4e46-929c-5b554d823e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:00.355919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c25a-f058-4e46-929c-5b554d823e9d service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:00.356196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c25a-f058-4e46-929c-5b554d823e9d service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:00.356469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c25a-f058-4e46-929c-5b554d823e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:00.358052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e8c5c25a-f058-4e46-929c-5b554d823e9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:00.446621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c25a-f058-4e46-929c-5b554d823e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:00.448199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5c25a-f058-4e46-929c-5b554d823e9d service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:00.465811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 713/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:01.586394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176220e-8a86-416e-a274-43805e0458ce None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:01.586982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176220e-8a86-416e-a274-43805e0458ce None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:01.586982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176220e-8a86-416e-a274-43805e0458ce None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:01.588274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:01.594694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc020-b10b-4f37-8a32-a8e0a3df2837 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:01.595097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc020-b10b-4f37-8a32-a8e0a3df2837 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:01.595253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc020-b10b-4f37-8a32-a8e0a3df2837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:01.670496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5abfc020-b10b-4f37-8a32-a8e0a3df2837 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:01.671682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5abfc020-b10b-4f37-8a32-a8e0a3df2837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:01.718947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:01.776190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:01.926476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176220e-8a86-416e-a274-43805e0458ce None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:01.927984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9176220e-8a86-416e-a274-43805e0458ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:02.072251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176220e-8a86-416e-a274-43805e0458ce None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:02.126761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:02.184756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79531bef-ed85-49cd-b3ce-dc8e98d5111d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:02.185288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531bef-ed85-49cd-b3ce-dc8e98d5111d service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:02.185570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531bef-ed85-49cd-b3ce-dc8e98d5111d service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:02.185877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531bef-ed85-49cd-b3ce-dc8e98d5111d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:02.187470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-79531bef-ed85-49cd-b3ce-dc8e98d5111d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:02.278942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79531bef-ed85-49cd-b3ce-dc8e98d5111d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:02.280574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79531bef-ed85-49cd-b3ce-dc8e98d5111d service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:02.299066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 723/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:03.407806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e0a9-8f31-468c-9ba8-1678bad90fd1 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:03.408331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e0a9-8f31-468c-9ba8-1678bad90fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:03.408331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87e0a9-8f31-468c-9ba8-1678bad90fd1 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:03.409698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:03.417654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59911-1fa8-41d6-8908-e67cf06c7ddf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:03.420296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59911-1fa8-41d6-8908-e67cf06c7ddf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:03.420296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59911-1fa8-41d6-8908-e67cf06c7ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:03.496354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-91f59911-1fa8-41d6-8908-e67cf06c7ddf None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:03.497546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-91f59911-1fa8-41d6-8908-e67cf06c7ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:03.499580 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:03.593631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:03.745582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e0a9-8f31-468c-9ba8-1678bad90fd1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:03.747138 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fa87e0a9-8f31-468c-9ba8-1678bad90fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:03.899924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87e0a9-8f31-468c-9ba8-1678bad90fd1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:03.927661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:04.012038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e2204-6b74-43da-ae9e-628370292fd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:04.012638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2204-6b74-43da-ae9e-628370292fd6 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:04.012921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2204-6b74-43da-ae9e-628370292fd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:04.013191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2204-6b74-43da-ae9e-628370292fd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:04.014843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f88e2204-6b74-43da-ae9e-628370292fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:04.103913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e2204-6b74-43da-ae9e-628370292fd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:04.105503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e2204-6b74-43da-ae9e-628370292fd6 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:04.123116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 716/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:06.452921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ab5f-fde0-46f9-b3c4-2b7c7ec3efb4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:06.453496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ab5f-fde0-46f9-b3c4-2b7c7ec3efb4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:06.453496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ab5f-fde0-46f9-b3c4-2b7c7ec3efb4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:06.454822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:06.460784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21d48f-f2a4-456a-be36-6e4b5fd7db1e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:06.461243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21d48f-f2a4-456a-be36-6e4b5fd7db1e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:06.461364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21d48f-f2a4-456a-be36-6e4b5fd7db1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:06.502014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:06.528121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4f21d48f-f2a4-456a-be36-6e4b5fd7db1e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:06.529344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4f21d48f-f2a4-456a-be36-6e4b5fd7db1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:06.629742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:06.914480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ab5f-fde0-46f9-b3c4-2b7c7ec3efb4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:06.916040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ec69ab5f-fde0-46f9-b3c4-2b7c7ec3efb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:07.021694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ab5f-fde0-46f9-b3c4-2b7c7ec3efb4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:07.054730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:07.096863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146ac5-98aa-491d-93b1-9029bd082287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:07.097477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146ac5-98aa-491d-93b1-9029bd082287 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:07.098453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146ac5-98aa-491d-93b1-9029bd082287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:07.099164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146ac5-98aa-491d-93b1-9029bd082287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:07.100753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db146ac5-98aa-491d-93b1-9029bd082287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:07.219081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146ac5-98aa-491d-93b1-9029bd082287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:07.221196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146ac5-98aa-491d-93b1-9029bd082287 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:07.239909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 726/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:09.568458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1c487-c25e-4cf5-bb2d-925a0544a1a5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:09.569002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1c487-c25e-4cf5-bb2d-925a0544a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:09.569120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1c487-c25e-4cf5-bb2d-925a0544a1a5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:09.570407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:09.575540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6680f2-ae57-447e-8fe4-5215471a0305 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:09.575969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6680f2-ae57-447e-8fe4-5215471a0305 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:09.576083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6680f2-ae57-447e-8fe4-5215471a0305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:09.641324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9a6680f2-ae57-447e-8fe4-5215471a0305 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:09.642550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a6680f2-ae57-447e-8fe4-5215471a0305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:09.655041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:09.740913 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:10.023719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1c487-c25e-4cf5-bb2d-925a0544a1a5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:10.025230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7da1c487-c25e-4cf5-bb2d-925a0544a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:10.128151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1c487-c25e-4cf5-bb2d-925a0544a1a5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:10.141579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:10.203375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa0461-7043-4419-baee-6e775c6864bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:10.203969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0461-7043-4419-baee-6e775c6864bb service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:10.204245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0461-7043-4419-baee-6e775c6864bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:10.204512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa0461-7043-4419-baee-6e775c6864bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:10.206094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-51aa0461-7043-4419-baee-6e775c6864bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:10.313508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa0461-7043-4419-baee-6e775c6864bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:10.314898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa0461-7043-4419-baee-6e775c6864bb service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:10.333055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 719/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:12.866948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c932195-8521-409d-8f69-47819478bde6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:12.867513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c932195-8521-409d-8f69-47819478bde6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:12.867513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c932195-8521-409d-8f69-47819478bde6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:12.868850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:12.874072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231802c-6261-46a7-ab5e-12986e1997d7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:12.874488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231802c-6261-46a7-ab5e-12986e1997d7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:12.874618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231802c-6261-46a7-ab5e-12986e1997d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:12.922298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:12.940234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3231802c-6261-46a7-ab5e-12986e1997d7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:12.941428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3231802c-6261-46a7-ab5e-12986e1997d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:13.037819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:13.323025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c932195-8521-409d-8f69-47819478bde6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:13.324550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8c932195-8521-409d-8f69-47819478bde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:13.430180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c932195-8521-409d-8f69-47819478bde6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:13.471472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:13.505023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912a89-03aa-4ec5-8795-6b9d03159830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:13.506246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a89-03aa-4ec5-8795-6b9d03159830 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:13.506524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a89-03aa-4ec5-8795-6b9d03159830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:13.506796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912a89-03aa-4ec5-8795-6b9d03159830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:13.508386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e6912a89-03aa-4ec5-8795-6b9d03159830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:13.617550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912a89-03aa-4ec5-8795-6b9d03159830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:13.619010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912a89-03aa-4ec5-8795-6b9d03159830 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:13.637213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 729/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:15.960903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccff81-709b-4856-bba1-bb0cc67132d5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:15.961434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccff81-709b-4856-bba1-bb0cc67132d5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:15.961434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccff81-709b-4856-bba1-bb0cc67132d5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:15.962839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:15.968578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95b9c-003b-41dd-a155-69ee6d8ccfa2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:15.969012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95b9c-003b-41dd-a155-69ee6d8ccfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:15.969165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c95b9c-003b-41dd-a155-69ee6d8ccfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:16.035860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-61c95b9c-003b-41dd-a155-69ee6d8ccfa2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:16.038149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-61c95b9c-003b-41dd-a155-69ee6d8ccfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:16.058500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:16.134238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:16.419566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccff81-709b-4856-bba1-bb0cc67132d5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:16.421094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-44ccff81-709b-4856-bba1-bb0cc67132d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:16.523921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccff81-709b-4856-bba1-bb0cc67132d5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:16.544335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:16.601628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14414c20-b073-418e-9108-8fc8574d3843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:16.602258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414c20-b073-418e-9108-8fc8574d3843 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:16.602540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414c20-b073-418e-9108-8fc8574d3843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:16.602810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414c20-b073-418e-9108-8fc8574d3843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:16.604379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-14414c20-b073-418e-9108-8fc8574d3843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:16.712259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14414c20-b073-418e-9108-8fc8574d3843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:16.713612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14414c20-b073-418e-9108-8fc8574d3843 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:16.732669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 722/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:18.947074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07a6a8-fd33-4200-b994-e1d5c87716bc None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:18.947612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07a6a8-fd33-4200-b994-e1d5c87716bc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:18.947612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07a6a8-fd33-4200-b994-e1d5c87716bc None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:18.948937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:18.954323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492a91-48e7-467c-8b48-a98a0b6d56b0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:18.954753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492a91-48e7-467c-8b48-a98a0b6d56b0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:18.954875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492a91-48e7-467c-8b48-a98a0b6d56b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:19.017282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:19.020024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-52492a91-48e7-467c-8b48-a98a0b6d56b0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:19.021436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-52492a91-48e7-467c-8b48-a98a0b6d56b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:19.119194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:19.408512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07a6a8-fd33-4200-b994-e1d5c87716bc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:19.410114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4d07a6a8-fd33-4200-b994-e1d5c87716bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:19.514756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07a6a8-fd33-4200-b994-e1d5c87716bc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:19.563070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:19.587931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047fb5b-6256-497c-86bc-aa1cdb2ffec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:19.588546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047fb5b-6256-497c-86bc-aa1cdb2ffec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:19.588827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047fb5b-6256-497c-86bc-aa1cdb2ffec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:19.589099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047fb5b-6256-497c-86bc-aa1cdb2ffec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:19.591663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6047fb5b-6256-497c-86bc-aa1cdb2ffec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:19.699903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047fb5b-6256-497c-86bc-aa1cdb2ffec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:19.701264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047fb5b-6256-497c-86bc-aa1cdb2ffec9 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:19.720595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 732/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:21.944727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb8ef3-9e0e-465c-8049-cbc39a36ee47 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:21.945355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb8ef3-9e0e-465c-8049-cbc39a36ee47 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:21.945355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb8ef3-9e0e-465c-8049-cbc39a36ee47 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:21.946656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:21.951944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ccb5a-9afe-4bdb-a892-78a8a832d48f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:21.952391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ccb5a-9afe-4bdb-a892-78a8a832d48f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:21.952504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ccb5a-9afe-4bdb-a892-78a8a832d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:22.019136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-024ccb5a-9afe-4bdb-a892-78a8a832d48f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:22.020253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-024ccb5a-9afe-4bdb-a892-78a8a832d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:22.048671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:22.117480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:22.404159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb8ef3-9e0e-465c-8049-cbc39a36ee47 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:22.405713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-decb8ef3-9e0e-465c-8049-cbc39a36ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:22.509060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb8ef3-9e0e-465c-8049-cbc39a36ee47 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:22.537288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:22.587584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0eabe-b048-475a-890c-6bdf86877f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:22.588187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0eabe-b048-475a-890c-6bdf86877f6d service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:22.588467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0eabe-b048-475a-890c-6bdf86877f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:22.588741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0eabe-b048-475a-890c-6bdf86877f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:22.590367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f9f0eabe-b048-475a-890c-6bdf86877f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:22.700805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0eabe-b048-475a-890c-6bdf86877f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:22.702183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0eabe-b048-475a-890c-6bdf86877f6d service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:22.720053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 725/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:25.048418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1594c8a-a5d7-4dbd-a1e8-a51ec3111222 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:25.048942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1594c8a-a5d7-4dbd-a1e8-a51ec3111222 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:25.048942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1594c8a-a5d7-4dbd-a1e8-a51ec3111222 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:25.050250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:25.056404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bee45-b42b-4149-9308-3460235be158 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:25.056404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bee45-b42b-4149-9308-3460235be158 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:25.056938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bee45-b42b-4149-9308-3460235be158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:25.123615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-162bee45-b42b-4149-9308-3460235be158 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:25.124811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-162bee45-b42b-4149-9308-3460235be158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:25.133825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:25.221623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:25.506876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1594c8a-a5d7-4dbd-a1e8-a51ec3111222 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:25.508400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e1594c8a-a5d7-4dbd-a1e8-a51ec3111222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:25.609437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1594c8a-a5d7-4dbd-a1e8-a51ec3111222 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:25.665158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:25.684029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c116a-c0ad-4f00-92cb-ac3af884226b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:25.685453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c116a-c0ad-4f00-92cb-ac3af884226b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:25.685453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c116a-c0ad-4f00-92cb-ac3af884226b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:25.685453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c116a-c0ad-4f00-92cb-ac3af884226b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:25.686835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-630c116a-c0ad-4f00-92cb-ac3af884226b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:25.796921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c116a-c0ad-4f00-92cb-ac3af884226b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:25.798420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c116a-c0ad-4f00-92cb-ac3af884226b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:25.817661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 735/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:28.004094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460f50-d4fc-4225-b987-80c9573ac72e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:28.004622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460f50-d4fc-4225-b987-80c9573ac72e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:28.004622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460f50-d4fc-4225-b987-80c9573ac72e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:28.006048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:28.011225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a435-46cc-4f6e-8d8b-d8105eb67c2b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:28.011616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a435-46cc-4f6e-8d8b-d8105eb67c2b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:28.011774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a435-46cc-4f6e-8d8b-d8105eb67c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:28.076323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6090a435-46cc-4f6e-8d8b-d8105eb67c2b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:28.077513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6090a435-46cc-4f6e-8d8b-d8105eb67c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:28.116225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:28.175477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:03:28.471999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460f50-d4fc-4225-b987-80c9573ac72e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:28.473523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a9460f50-d4fc-4225-b987-80c9573ac72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:28.575148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9460f50-d4fc-4225-b987-80c9573ac72e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:28.612938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:28.650546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a064e-c22d-46ab-af6a-592811f033d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:28.651152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a064e-c22d-46ab-af6a-592811f033d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:28.651431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a064e-c22d-46ab-af6a-592811f033d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:28.651700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a064e-c22d-46ab-af6a-592811f033d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:28.653285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-377a064e-c22d-46ab-af6a-592811f033d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:28.762171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a064e-c22d-46ab-af6a-592811f033d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:28.763592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a064e-c22d-46ab-af6a-592811f033d3 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:28.781772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 728/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:30.962522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69a0d-fb09-442e-adaf-f74b3b52ef59 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:30.963052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69a0d-fb09-442e-adaf-f74b3b52ef59 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:30.963052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69a0d-fb09-442e-adaf-f74b3b52ef59 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:30.964296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:30.970856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb22cba-3154-4d1b-a8b4-4374c628e251 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:30.971345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb22cba-3154-4d1b-a8b4-4374c628e251 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:30.971455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb22cba-3154-4d1b-a8b4-4374c628e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:31.038609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7bb22cba-3154-4d1b-a8b4-4374c628e251 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:31.039815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7bb22cba-3154-4d1b-a8b4-4374c628e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:31.058707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:31.137054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:31.424083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69a0d-fb09-442e-adaf-f74b3b52ef59 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:31.425590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e0d69a0d-fb09-442e-adaf-f74b3b52ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:31.528530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69a0d-fb09-442e-adaf-f74b3b52ef59 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:31.594797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:31.602029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a02c-c92d-49b0-81ea-f32b965b97ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:31.602638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a02c-c92d-49b0-81ea-f32b965b97ea service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:31.602920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a02c-c92d-49b0-81ea-f32b965b97ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:31.603194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a02c-c92d-49b0-81ea-f32b965b97ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:31.604775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9da8a02c-c92d-49b0-81ea-f32b965b97ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:31.712550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a02c-c92d-49b0-81ea-f32b965b97ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:31.714020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a02c-c92d-49b0-81ea-f32b965b97ea service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:31.732991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 738/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:33.943841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca07a-f399-4821-aec3-a6715b555850 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:33.944399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca07a-f399-4821-aec3-a6715b555850 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:33.944399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca07a-f399-4821-aec3-a6715b555850 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:33.945735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:33.951172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e1a08-d488-472b-9efa-2a55755491fc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:33.951573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e1a08-d488-472b-9efa-2a55755491fc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:33.951729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e1a08-d488-472b-9efa-2a55755491fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:34.023035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ff8e1a08-d488-472b-9efa-2a55755491fc None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:34.024231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ff8e1a08-d488-472b-9efa-2a55755491fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:34.075999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:34.124585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:03:34.420778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca07a-f399-4821-aec3-a6715b555850 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:34.422356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-db3ca07a-f399-4821-aec3-a6715b555850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:34.526299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca07a-f399-4821-aec3-a6715b555850 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:34.573478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:34.599589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a58cc0-11d4-459a-9a37-444bbd073f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:34.600212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58cc0-11d4-459a-9a37-444bbd073f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:34.600497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58cc0-11d4-459a-9a37-444bbd073f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:34.600941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58cc0-11d4-459a-9a37-444bbd073f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:34.603622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-96a58cc0-11d4-459a-9a37-444bbd073f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:34.713779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a58cc0-11d4-459a-9a37-444bbd073f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:34.715142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a58cc0-11d4-459a-9a37-444bbd073f75 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:34.733877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 731/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:44.148869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=22 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:44.731543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=66 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:54.922224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c41e-b103-4f84-89df-7475b5955525 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:54.922819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c41e-b103-4f84-89df-7475b5955525 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:54.922819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c41e-b103-4f84-89df-7475b5955525 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:54.924097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 740/1471] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:54.929696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177b19-2691-4131-a3cf-1c3dd55e93d3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:54.930189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177b19-2691-4131-a3cf-1c3dd55e93d3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:54.930311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177b19-2691-4131-a3cf-1c3dd55e93d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:54.997804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-14177b19-2691-4131-a3cf-1c3dd55e93d3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:54.999003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-14177b19-2691-4131-a3cf-1c3dd55e93d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:55.103681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 732/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:03:55.405089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f276c-84ac-4585-88d5-115c8a1a8c36 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:55.405385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f276c-84ac-4585-88d5-115c8a1a8c36 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:55.405664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f276c-84ac-4585-88d5-115c8a1a8c36 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:55.407052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 741/1473] 10.222.0.26 () {54 vars in 962 bytes} [Mon Oct 3 16:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:55.412416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda653a-cd9a-4192-80ee-0f1ee4fe08b6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:55.412724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda653a-cd9a-4192-80ee-0f1ee4fe08b6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:55.412997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda653a-cd9a-4192-80ee-0f1ee4fe08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:55.490313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1fda653a-cd9a-4192-80ee-0f1ee4fe08b6 None None] MFA Rules not processed for user `31f9685c8b244249b2d29f4612a3e5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:55.491559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1fda653a-cd9a-4192-80ee-0f1ee4fe08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:55.512599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:55.568770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 733/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Oct 3 16:03:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:55.576562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f276c-84ac-4585-88d5-115c8a1a8c36 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:55.578072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c78f276c-84ac-4585-88d5-115c8a1a8c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:55.682222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f276c-84ac-4585-88d5-115c8a1a8c36 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:55.756182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90408ee-7941-436a-9867-c92896f7209e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9685c8b244249b2d29f4612a3e5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:55.756786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90408ee-7941-436a-9867-c92896f7209e service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:55.757060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90408ee-7941-436a-9867-c92896f7209e service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:55.757328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90408ee-7941-436a-9867-c92896f7209e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:55.758940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b90408ee-7941-436a-9867-c92896f7209e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:55.812093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:55.867646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90408ee-7941-436a-9867-c92896f7209e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:55.869081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90408ee-7941-436a-9867-c92896f7209e service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:55.887061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 742/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:03:58.129947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82d8d-88ca-4a98-82f6-cdafa6a10731 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:58.130483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82d8d-88ca-4a98-82f6-cdafa6a10731 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:58.130648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de82d8d-88ca-4a98-82f6-cdafa6a10731 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:58.131988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 734/1476] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:03:58.137207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3cb7b-12b5-4714-879a-154295c86742 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:58.137608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3cb7b-12b5-4714-879a-154295c86742 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:58.137777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3cb7b-12b5-4714-879a-154295c86742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:58.204815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b9a3cb7b-12b5-4714-879a-154295c86742 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:03:58.206042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b9a3cb7b-12b5-4714-879a-154295c86742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:58.303993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 743/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:03:58.579001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de82d8d-88ca-4a98-82f6-cdafa6a10731 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:03:58.580520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4de82d8d-88ca-4a98-82f6-cdafa6a10731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:03:58.709366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de82d8d-88ca-4a98-82f6-cdafa6a10731 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:03:58.759796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:03:58.804448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e46d-62fc-4e42-805b-e3aa4f1e4a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:03:58.805053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e46d-62fc-4e42-805b-e3aa4f1e4a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:03:58.805342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e46d-62fc-4e42-805b-e3aa4f1e4a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:03:58.805618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e46d-62fc-4e42-805b-e3aa4f1e4a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:03:58.806290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e46d-62fc-4e42-805b-e3aa4f1e4a51 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:03:58.808099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-3427e46d-62fc-4e42-805b-e3aa4f1e4a51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:03:58.808099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:03:58.808099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:03:58.809243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e46d-62fc-4e42-805b-e3aa4f1e4a51 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:03:58.828643 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 735/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Oct 3 16:03:58 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:04:01.005479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789558-7199-4811-a991-f968b63f976e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:01.006048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789558-7199-4811-a991-f968b63f976e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:01.006048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31789558-7199-4811-a991-f968b63f976e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:01.007397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 744/1479] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:04:01.012630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ddec-734d-4f45-b7aa-ff38da5ccc62 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:01.013060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ddec-734d-4f45-b7aa-ff38da5ccc62 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:01.013271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924ddec-734d-4f45-b7aa-ff38da5ccc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:01.078717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2924ddec-734d-4f45-b7aa-ff38da5ccc62 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:04:01.079901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2924ddec-734d-4f45-b7aa-ff38da5ccc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:01.174333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 736/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:04:01.466824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31789558-7199-4811-a991-f968b63f976e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:04:01.468594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-31789558-7199-4811-a991-f968b63f976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:01.479005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:01.613460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31789558-7199-4811-a991-f968b63f976e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:04:01.692409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:01.725255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfe0bf-9c31-45f9-95e5-b81a6140b511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:04:01.725808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfe0bf-9c31-45f9-95e5-b81a6140b511 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:01.726092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfe0bf-9c31-45f9-95e5-b81a6140b511 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:01.726363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfe0bf-9c31-45f9-95e5-b81a6140b511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:01.728677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-02cfe0bf-9c31-45f9-95e5-b81a6140b511 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:01.817679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfe0bf-9c31-45f9-95e5-b81a6140b511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:04:01.819398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfe0bf-9c31-45f9-95e5-b81a6140b511 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:04:01.837808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 745/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:04:04.172926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc041d1a-10ae-4c54-92fc-e45d4a9b5636 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:04.173496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc041d1a-10ae-4c54-92fc-e45d4a9b5636 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:04.173496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc041d1a-10ae-4c54-92fc-e45d4a9b5636 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:04.174858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 737/1482] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:04:04.180814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd889-b68f-4a8a-aeab-b28476fa7944 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:04.181218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd889-b68f-4a8a-aeab-b28476fa7944 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:04.181358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd889-b68f-4a8a-aeab-b28476fa7944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:04.248064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a77cd889-b68f-4a8a-aeab-b28476fa7944 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:04:04.249231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a77cd889-b68f-4a8a-aeab-b28476fa7944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:04.295065 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:04.344901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 746/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:04:04.644112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc041d1a-10ae-4c54-92fc-e45d4a9b5636 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:04:04.646348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cc041d1a-10ae-4c54-92fc-e45d4a9b5636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:04.670671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:04.757682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc041d1a-10ae-4c54-92fc-e45d4a9b5636 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:04:04.836639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747c8f2-37ac-49a8-9aa8-b5c277b3436c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:04:04.837254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747c8f2-37ac-49a8-9aa8-b5c277b3436c service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:04.837537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747c8f2-37ac-49a8-9aa8-b5c277b3436c service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:04.837833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747c8f2-37ac-49a8-9aa8-b5c277b3436c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:04.839422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9747c8f2-37ac-49a8-9aa8-b5c277b3436c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:04.915185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:04.950274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747c8f2-37ac-49a8-9aa8-b5c277b3436c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:04:04.951754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747c8f2-37ac-49a8-9aa8-b5c277b3436c service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:04:04.970831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 738/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:04:07.334667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffc49-80ee-40ff-bb43-7174f4e8f780 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:07.335224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffc49-80ee-40ff-bb43-7174f4e8f780 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:07.335224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afffc49-80ee-40ff-bb43-7174f4e8f780 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:07.336759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 747/1485] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:04:07.341973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a42fb-66fe-437c-96c5-78b20bfe7998 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:07.342628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a42fb-66fe-437c-96c5-78b20bfe7998 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:07.342782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a42fb-66fe-437c-96c5-78b20bfe7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:07.409086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c24a42fb-66fe-437c-96c5-78b20bfe7998 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:04:07.410346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c24a42fb-66fe-437c-96c5-78b20bfe7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:07.507915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 739/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:04:07.793424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffc49-80ee-40ff-bb43-7174f4e8f780 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:04:07.794991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2afffc49-80ee-40ff-bb43-7174f4e8f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:07.898194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afffc49-80ee-40ff-bb43-7174f4e8f780 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:04:07.970660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:07.972109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7f1a4-5821-4dc3-b0ad-d756a3e20827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:04:07.972701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f1a4-5821-4dc3-b0ad-d756a3e20827 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:07.973075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f1a4-5821-4dc3-b0ad-d756a3e20827 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:07.973433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7f1a4-5821-4dc3-b0ad-d756a3e20827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:07.974989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-81f7f1a4-5821-4dc3-b0ad-d756a3e20827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:08.081702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7f1a4-5821-4dc3-b0ad-d756a3e20827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:04:08.083678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7f1a4-5821-4dc3-b0ad-d756a3e20827 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:04:08.101454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 748/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:04:10.446968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e798-0045-4fc0-8d20-1edc7389111e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:10.447545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e798-0045-4fc0-8d20-1edc7389111e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:10.447545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17e798-0045-4fc0-8d20-1edc7389111e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:10.448851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 740/1488] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:04:10.454049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425921e-f45f-4071-8c90-182a239b27f7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:10.454501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425921e-f45f-4071-8c90-182a239b27f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:10.454603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425921e-f45f-4071-8c90-182a239b27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:10.522526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0425921e-f45f-4071-8c90-182a239b27f7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:04:10.523744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0425921e-f45f-4071-8c90-182a239b27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:10.576158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:10.620617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 749/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:04:10.929579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17e798-0045-4fc0-8d20-1edc7389111e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:04:10.931143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ef17e798-0045-4fc0-8d20-1edc7389111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:10.966667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:11.034328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17e798-0045-4fc0-8d20-1edc7389111e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:04:11.110607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add4229-b269-4784-b9b9-550ac6b00976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:04:11.111741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4229-b269-4784-b9b9-550ac6b00976 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:11.111741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4229-b269-4784-b9b9-550ac6b00976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:11.112006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add4229-b269-4784-b9b9-550ac6b00976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:11.113332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7add4229-b269-4784-b9b9-550ac6b00976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:11.193013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:11.221340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add4229-b269-4784-b9b9-550ac6b00976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:04:11.222940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add4229-b269-4784-b9b9-550ac6b00976 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:04:11.242407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 741/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:04:13.825930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc924-d566-4be8-b3ee-0e251f70a78b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:13.826493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc924-d566-4be8-b3ee-0e251f70a78b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:13.826493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc924-d566-4be8-b3ee-0e251f70a78b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:13.827801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 750/1491] 10.222.0.26 () {54 vars in 927 bytes} [Mon Oct 3 16:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:04:13.833871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80e6c-4273-42f2-a60d-0b3bb99865b2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:13.834298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80e6c-4273-42f2-a60d-0b3bb99865b2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:13.834393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e80e6c-4273-42f2-a60d-0b3bb99865b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:13.899484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-25e80e6c-4273-42f2-a60d-0b3bb99865b2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:04:13.902920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-25e80e6c-4273-42f2-a60d-0b3bb99865b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:13.995504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 742/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Mon Oct 3 16:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:04:14.282193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cc924-d566-4be8-b3ee-0e251f70a78b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:04:14.283729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0a0cc924-d566-4be8-b3ee-0e251f70a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:14.388858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cc924-d566-4be8-b3ee-0e251f70a78b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:04:14.464557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753de4e-eb78-43d0-a0b3-1e0decaebe6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:04:14.465158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753de4e-eb78-43d0-a0b3-1e0decaebe6b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:04:14.465434 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753de4e-eb78-43d0-a0b3-1e0decaebe6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:04:14.465703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753de4e-eb78-43d0-a0b3-1e0decaebe6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:04:14.467557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0753de4e-eb78-43d0-a0b3-1e0decaebe6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:04:14.476675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:14.577052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753de4e-eb78-43d0-a0b3-1e0decaebe6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:04:14.578461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753de4e-eb78-43d0-a0b3-1e0decaebe6b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:04:14.597448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 751/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:04:23.993972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=82 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:04:24.595211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=50 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:43.829330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:43.829900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:43.829900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:43.904965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:05:43.906193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:44.001819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 743/1494] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:05:44.010347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ee8e-241b-40fb-bee0-52f83e78b619 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:44.010848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ee8e-241b-40fb-bee0-52f83e78b619 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:44.010957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ee8e-241b-40fb-bee0-52f83e78b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:44.088068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c2e7ee8e-241b-40fb-bee0-52f83e78b619 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:05:44.089285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c2e7ee8e-241b-40fb-bee0-52f83e78b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:44.187118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 752/1495] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:05:44.192332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:44.193514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:44.204597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f22f8a-3ea5-4dfd-a221-15d4d11f4d79 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:44.264755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:44.297136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:44.297738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:44.298104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:44.298379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:44.299016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:05:44.299316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:44.300852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:44.300852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:05:44.300852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:05:44.301733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:44.313129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 744/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:05:44.322214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ee8e-241b-40fb-bee0-52f83e78b619 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:44.331172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ee8e-241b-40fb-bee0-52f83e78b619 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:44.391988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:44.426382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:44.426986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:44.427271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:44.427541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:44.428161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:44.429924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:44.429924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: warnings.warn(msg) Oct 03 16:05:44.429924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: Oct 03 16:05:44.431118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:44.543619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 753/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:05:44 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:05:44.547764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:44.549340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:44.583703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2926b6-2c8c-430d-8db0-5fe88cea647e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:44.677028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:44.677638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:44.677948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:44.678222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:44.678858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:44.679870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:44.679870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:05:44.679870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:05:44.681075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:44.819005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 745/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:05:44 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:05:44.823200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:44.824730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:44.886430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0e854-072d-4da7-a16c-0f8551aef9f6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:44.973501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:44.983726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:44.984333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:44.984615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:44.984885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:44.985519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:44.986579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:44.986579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: warnings.warn(msg) Oct 03 16:05:44.986579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: Oct 03 16:05:44.987547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:45.000631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 754/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:05:45.004866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:45.009863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:45.017698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde85a7c-97ab-4dc5-85c4-57d917760478 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:45.044166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:45.112951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1514c6-e19b-4615-96d4-9dc0eae84145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:45.113525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1514c6-e19b-4615-96d4-9dc0eae84145 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:45.118344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1514c6-e19b-4615-96d4-9dc0eae84145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:45.118344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1514c6-e19b-4615-96d4-9dc0eae84145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:45.118344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1514c6-e19b-4615-96d4-9dc0eae84145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:45.118344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-0d1514c6-e19b-4615-96d4-9dc0eae84145 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:45.118344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:05:45.118344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:05:45.118344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1514c6-e19b-4615-96d4-9dc0eae84145 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:45.129929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 746/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:05:45.134152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:45.135713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:45.171574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545df3-bb8d-467d-86fd-c2bc8274bdbb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:45.265593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fa04-4d39-4e36-95e1-178858828a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:45.266274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fa04-4d39-4e36-95e1-178858828a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:45.266554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fa04-4d39-4e36-95e1-178858828a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:45.266826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fa04-4d39-4e36-95e1-178858828a0e admin admin] PATH_INFO: `/v3/projects/45b281c9527e4c7fa7509fb197f779d6/users/8cf2de936ff6421b994678bed42999f0/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:45.289840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fa04-4d39-4e36-95e1-178858828a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b281c9527e4c7fa7509fb197f779d6, user_id=8cf2de936ff6421b994678bed42999f0, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:45.290873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-be44fa04-4d39-4e36-95e1-178858828a0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:45.290873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: warnings.warn(msg) Oct 03 16:05:45.290873 dv-cinder-844563-13-smb devstack@keystone.service[81564]: Oct 03 16:05:45.292826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fa04-4d39-4e36-95e1-178858828a0e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:45.374162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 755/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:05:45 2022] PUT /identity/v3/projects/45b281c9527e4c7fa7509fb197f779d6/users/8cf2de936ff6421b994678bed42999f0/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:05:45.387465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a245b-382e-496d-912c-f844fd4b2131 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:45.387753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a245b-382e-496d-912c-f844fd4b2131 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:45.388032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a245b-382e-496d-912c-f844fd4b2131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:45.445007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-291a245b-382e-496d-912c-f844fd4b2131 None None] MFA Rules not processed for user `8cf2de936ff6421b994678bed42999f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:05:45.446258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-291a245b-382e-496d-912c-f844fd4b2131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:45.527075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 747/1502] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:05:45.540281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846858-0733-4784-9165-650771f0096c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:45.540569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846858-0733-4784-9165-650771f0096c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:45.540846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846858-0733-4784-9165-650771f0096c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:45.542222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 756/1503] 10.222.0.26 () {54 vars in 963 bytes} [Mon Oct 3 16:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:05:45.547082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909ad2-9ca2-482f-a33d-d054a82f67f8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:45.547368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909ad2-9ca2-482f-a33d-d054a82f67f8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:45.547644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7909ad2-9ca2-482f-a33d-d054a82f67f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:45.580864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:45.624998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b7909ad2-9ca2-482f-a33d-d054a82f67f8 None None] MFA Rules not processed for user `8869c7baa4124705bcb3a8c835f566a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:05:45.626227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b7909ad2-9ca2-482f-a33d-d054a82f67f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:45.701683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 748/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Oct 3 16:05:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:05:45.709914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce846858-0733-4784-9165-650771f0096c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:45.711427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ce846858-0733-4784-9165-650771f0096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:45.762134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:45.815498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce846858-0733-4784-9165-650771f0096c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:45.892522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:45.893236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:45.893518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:45.893817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:45.895961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:45.995682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:45.997554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:46.001393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:46.017535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 757/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:05:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:05:46.065538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fc96-9c15-4da4-9de3-960661107f1c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:46.066366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fc96-9c15-4da4-9de3-960661107f1c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:46.066645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81fc96-9c15-4da4-9de3-960661107f1c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:46.067893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 749/1506] 10.222.0.26 () {52 vars in 830 bytes} [Mon Oct 3 16:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:05:46.071441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:46.072657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:46.173331 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb2a15-1457-4486-b605-b19d8b25b153 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:46.268212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:46.268840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:46.269619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:46.269937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] PATH_INFO: `/v3/users/8cf2de936ff6421b994678bed42999f0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:46.282789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf2de936ff6421b994678bed42999f0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:46.283811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:46.283811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: warnings.warn(msg) Oct 03 16:05:46.283811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: Oct 03 16:05:46.286124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:46.295805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:46.494624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf2de936ff6421b994678bed42999f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:46.564527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf2de936ff6421b994678bed42999f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:46.579317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf2de936ff6421b994678bed42999f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:46.579894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf2de936ff6421b994678bed42999f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:46.605130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf2de936ff6421b994678bed42999f0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:46.610923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 758/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:05:46 2022] DELETE /identity/v3/users/8cf2de936ff6421b994678bed42999f0 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:05:46.615360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:46.615674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:46.616417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:46.674311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:05:46.675957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:46.751973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:46.764636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 750/1508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:05:46.774998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:46.776238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:46.878772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cbd6a-8c9e-4273-896c-0532d6da787b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:46.938429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:46.959550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef185d-3b6b-4f51-aaa4-2e1ed99fceef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:46.960161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef185d-3b6b-4f51-aaa4-2e1ed99fceef service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:46.960440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef185d-3b6b-4f51-aaa4-2e1ed99fceef service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:46.960715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef185d-3b6b-4f51-aaa4-2e1ed99fceef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:46.962361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a3ef185d-3b6b-4f51-aaa4-2e1ed99fceef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:47.072638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef185d-3b6b-4f51-aaa4-2e1ed99fceef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:47.074083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef185d-3b6b-4f51-aaa4-2e1ed99fceef service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:47.092936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 759/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:05:47.592621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:05:47.594245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:05:47.606760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139d04-1671-4b43-bc0c-228af1f94d40 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:05:47.708874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:05:47.709505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:05:47.709810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:05:47.710088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] PATH_INFO: `/v3/projects/45b281c9527e4c7fa7509fb197f779d6` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:05:47.721674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b281c9527e4c7fa7509fb197f779d6)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:05:47.723978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:05:47.723978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:05:47.723978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:05:47.725158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:05:47.834430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b281c9527e4c7fa7509fb197f779d6', 'request_id': 'req-990b9a14-61d3-48b0-a502-ab39078b1d30'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:47.848861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b281c9527e4c7fa7509fb197f779d6', 'request_id': 'req-990b9a14-61d3-48b0-a502-ab39078b1d30'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:47.855006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b281c9527e4c7fa7509fb197f779d6', 'request_id': 'req-990b9a14-61d3-48b0-a502-ab39078b1d30'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:47.939657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] The token cache is being invalidate because project 45b281c9527e4c7fa7509fb197f779d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:05:47.941945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:47.942514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-990b9a14-61d3-48b0-a502-ab39078b1d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:05:47.943856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 751/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:05:47 2022] DELETE /identity/v3/projects/45b281c9527e4c7fa7509fb197f779d6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:05:57.090799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=62 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:05:57.937185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:20.846082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071051-7dbf-4eef-be9d-c09096401222 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:20.846654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071051-7dbf-4eef-be9d-c09096401222 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:20.846654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30071051-7dbf-4eef-be9d-c09096401222 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:20.847885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:20.853422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0e25-988f-4f83-bc84-28c1e5123c28 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:20.853871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0e25-988f-4f83-bc84-28c1e5123c28 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:20.854014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0e25-988f-4f83-bc84-28c1e5123c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:20.933671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6eeb0e25-988f-4f83-bc84-28c1e5123c28 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:20.934917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6eeb0e25-988f-4f83-bc84-28c1e5123c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:21.034298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:21.191092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30071051-7dbf-4eef-be9d-c09096401222 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:21.193277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-30071051-7dbf-4eef-be9d-c09096401222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:21.315266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30071051-7dbf-4eef-be9d-c09096401222 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:21.321035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b537-67d6-48bf-a8ce-e98c32bbf2e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:21.321647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b537-67d6-48bf-a8ce-e98c32bbf2e0 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:21.321957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b537-67d6-48bf-a8ce-e98c32bbf2e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:21.322235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b537-67d6-48bf-a8ce-e98c32bbf2e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:21.330218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b537-67d6-48bf-a8ce-e98c32bbf2e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:21.331797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b537-67d6-48bf-a8ce-e98c32bbf2e0 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:21.342062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 761/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:22.430487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1188249-900a-420d-b2a8-f1d9f19a141c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:22.431010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1188249-900a-420d-b2a8-f1d9f19a141c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:22.431116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1188249-900a-420d-b2a8-f1d9f19a141c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:22.432451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:22.439047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2004-fc0e-4d3e-9fb9-607dc11da57d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:22.439491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2004-fc0e-4d3e-9fb9-607dc11da57d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:22.439594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2004-fc0e-4d3e-9fb9-607dc11da57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:22.459692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f40b2004-fc0e-4d3e-9fb9-607dc11da57d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:22.461251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f40b2004-fc0e-4d3e-9fb9-607dc11da57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:22.469328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:22.628600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1188249-900a-420d-b2a8-f1d9f19a141c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:22.643210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1188249-900a-420d-b2a8-f1d9f19a141c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:22.649556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b08ce8-cd5a-4b92-a65f-4b6637f76fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:22.650200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08ce8-cd5a-4b92-a65f-4b6637f76fa4 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:22.650488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08ce8-cd5a-4b92-a65f-4b6637f76fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:22.650759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b08ce8-cd5a-4b92-a65f-4b6637f76fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:22.659090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b08ce8-cd5a-4b92-a65f-4b6637f76fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:22.660664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b08ce8-cd5a-4b92-a65f-4b6637f76fa4 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:22.670860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 754/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:22.772381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588c69-8800-4cb0-a8c9-22ae2c8a761d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:22.773179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588c69-8800-4cb0-a8c9-22ae2c8a761d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:22.773459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06588c69-8800-4cb0-a8c9-22ae2c8a761d None None] PATH_INFO: `/v3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:22.774788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 763/1517] 10.222.0.16 () {54 vars in 925 bytes} [Mon Oct 3 16:07:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:07:22.781209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02132-cb91-453d-a941-a685959bb6e3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:22.781472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02132-cb91-453d-a941-a685959bb6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:22.781747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02132-cb91-453d-a941-a685959bb6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:22.845496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b7f02132-cb91-453d-a941-a685959bb6e3 None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:22.847031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b7f02132-cb91-453d-a941-a685959bb6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:22.864837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:22.921868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 755/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Oct 3 16:07:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:26.704040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e954e-103d-41b8-a074-325eb068f4bc None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:26.704564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e954e-103d-41b8-a074-325eb068f4bc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:26.704671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e954e-103d-41b8-a074-325eb068f4bc None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:26.705978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 764/1519] 10.222.0.26 () {54 vars in 961 bytes} [Mon Oct 3 16:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:26.711144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31051dc-c06a-49a2-83c4-d20c0dd88dfe None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:26.711735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31051dc-c06a-49a2-83c4-d20c0dd88dfe None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:26.711735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31051dc-c06a-49a2-83c4-d20c0dd88dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:26.732391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b31051dc-c06a-49a2-83c4-d20c0dd88dfe None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:26.733945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b31051dc-c06a-49a2-83c4-d20c0dd88dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:26.742135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 756/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Oct 3 16:07:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:26.750785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e954e-103d-41b8-a074-325eb068f4bc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:26.764310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e954e-103d-41b8-a074-325eb068f4bc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:26.769265 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107a602-6b6f-4dbc-af37-567361e8fb5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:26.769909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a602-6b6f-4dbc-af37-567361e8fb5b service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:26.770189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a602-6b6f-4dbc-af37-567361e8fb5b service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:26.770459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107a602-6b6f-4dbc-af37-567361e8fb5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:26.778913 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107a602-6b6f-4dbc-af37-567361e8fb5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:26.780484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107a602-6b6f-4dbc-af37-567361e8fb5b service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:26.790857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 765/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:34.197106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3b3d-be47-4187-89ea-4c09f088f19a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:34.197722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3b3d-be47-4187-89ea-4c09f088f19a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:34.197722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff3b3d-be47-4187-89ea-4c09f088f19a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:34.199041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:34.205596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddcab2-9b37-4e70-a80a-213b1fcf2235 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:34.206047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddcab2-9b37-4e70-a80a-213b1fcf2235 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:34.206184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddcab2-9b37-4e70-a80a-213b1fcf2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:34.226094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4cddcab2-9b37-4e70-a80a-213b1fcf2235 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:34.227276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4cddcab2-9b37-4e70-a80a-213b1fcf2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:34.234914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:34.388445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3b3d-be47-4187-89ea-4c09f088f19a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:34.403350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff3b3d-be47-4187-89ea-4c09f088f19a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:34.409205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358d36-0942-4ebc-99a4-e9028a8a49dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:34.409821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358d36-0942-4ebc-99a4-e9028a8a49dc service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:34.410106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358d36-0942-4ebc-99a4-e9028a8a49dc service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:34.410378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358d36-0942-4ebc-99a4-e9028a8a49dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:34.418545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358d36-0942-4ebc-99a4-e9028a8a49dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:34.420156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358d36-0942-4ebc-99a4-e9028a8a49dc service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:34.429330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 758/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:35.528209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c10d90-7bc0-459e-9c14-e0f5282fafe5 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:35.528754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c10d90-7bc0-459e-9c14-e0f5282fafe5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:35.528754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c10d90-7bc0-459e-9c14-e0f5282fafe5 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:35.530095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 16:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:35.536086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717cce-1ad2-4385-bbf9-a50c255d33b9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:35.536523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717cce-1ad2-4385-bbf9-a50c255d33b9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:35.536616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21717cce-1ad2-4385-bbf9-a50c255d33b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:35.556983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-21717cce-1ad2-4385-bbf9-a50c255d33b9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:35.558194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-21717cce-1ad2-4385-bbf9-a50c255d33b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:35.565876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 16:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:35.718769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c10d90-7bc0-459e-9c14-e0f5282fafe5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:35.734712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c10d90-7bc0-459e-9c14-e0f5282fafe5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:35.740275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c648-1946-4f9a-acaa-511e4020f7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:35.740876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c648-1946-4f9a-acaa-511e4020f7ac service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:35.741154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c648-1946-4f9a-acaa-511e4020f7ac service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:35.741425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c648-1946-4f9a-acaa-511e4020f7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:35.749833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c648-1946-4f9a-acaa-511e4020f7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:35.751403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c648-1946-4f9a-acaa-511e4020f7ac service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:35.761012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 768/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:39.863767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092567-ae21-4046-b1d3-69f3127ee5cb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:39.864338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092567-ae21-4046-b1d3-69f3127ee5cb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:39.864338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092567-ae21-4046-b1d3-69f3127ee5cb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:39.865640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:39.871481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a167-1246-44e1-9914-c068fb8c6058 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:39.871867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a167-1246-44e1-9914-c068fb8c6058 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:39.872045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582a167-1246-44e1-9914-c068fb8c6058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:39.893121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e582a167-1246-44e1-9914-c068fb8c6058 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:39.894390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e582a167-1246-44e1-9914-c068fb8c6058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:39.903776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:40.194739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092567-ae21-4046-b1d3-69f3127ee5cb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:40.198646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-67092567-ae21-4046-b1d3-69f3127ee5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:40.279739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092567-ae21-4046-b1d3-69f3127ee5cb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:40.283290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2f0e6-de1e-4256-bf15-7c423f68a326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:40.283889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f0e6-de1e-4256-bf15-7c423f68a326 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:40.284167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f0e6-de1e-4256-bf15-7c423f68a326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:40.284443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2f0e6-de1e-4256-bf15-7c423f68a326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:40.293793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2f0e6-de1e-4256-bf15-7c423f68a326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:40.295210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2f0e6-de1e-4256-bf15-7c423f68a326 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:40.304370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 761/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:42.502714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d00a0-f596-4c7f-8932-ca51e39b744f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:42.503258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d00a0-f596-4c7f-8932-ca51e39b744f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:42.503258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d00a0-f596-4c7f-8932-ca51e39b744f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:42.504584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 16:07:42.510445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159425-9a38-4136-9b98-58a56c48e4b9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:42.510915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159425-9a38-4136-9b98-58a56c48e4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:42.511021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af159425-9a38-4136-9b98-58a56c48e4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:42.530909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-af159425-9a38-4136-9b98-58a56c48e4b9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:42.532096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-af159425-9a38-4136-9b98-58a56c48e4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:42.540127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:42.831436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d00a0-f596-4c7f-8932-ca51e39b744f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:42.842129 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d00a0-f596-4c7f-8932-ca51e39b744f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:42.845596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fb6fc-8210-40a7-85dd-3455e7d51fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:42.846482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb6fc-8210-40a7-85dd-3455e7d51fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:42.846763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb6fc-8210-40a7-85dd-3455e7d51fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:42.847034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fb6fc-8210-40a7-85dd-3455e7d51fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:42.855815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fb6fc-8210-40a7-85dd-3455e7d51fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:42.857238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fb6fc-8210-40a7-85dd-3455e7d51fa0 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:42.866484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 771/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:46.562905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61b49-de6a-40ef-a0a1-20b8bf62289d None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:46.563464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61b49-de6a-40ef-a0a1-20b8bf62289d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:46.563464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61b49-de6a-40ef-a0a1-20b8bf62289d None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:46.564796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:46.569840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8fd9e-19ed-4390-bf96-4f934e419560 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:46.570269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8fd9e-19ed-4390-bf96-4f934e419560 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:46.570431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8fd9e-19ed-4390-bf96-4f934e419560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:46.590134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3cd8fd9e-19ed-4390-bf96-4f934e419560 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:46.591374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3cd8fd9e-19ed-4390-bf96-4f934e419560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:46.599277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:46.905677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61b49-de6a-40ef-a0a1-20b8bf62289d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:46.907361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-20c61b49-de6a-40ef-a0a1-20b8bf62289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:46.970690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:46.984101 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61b49-de6a-40ef-a0a1-20b8bf62289d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:46.990989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6afe-51f1-474d-b7ff-1edfeafec383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:46.990989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6afe-51f1-474d-b7ff-1edfeafec383 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:46.990989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6afe-51f1-474d-b7ff-1edfeafec383 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:46.990989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6afe-51f1-474d-b7ff-1edfeafec383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:46.998058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6afe-51f1-474d-b7ff-1edfeafec383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:46.999474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6afe-51f1-474d-b7ff-1edfeafec383 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:47.008777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 764/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:49.152446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19a67-bc70-479c-840d-c496bca3ce67 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:49.153039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19a67-bc70-479c-840d-c496bca3ce67 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:49.153039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19a67-bc70-479c-840d-c496bca3ce67 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:49.154738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 16:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:07:49.160452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dd917-c51c-40e9-a120-c70845b794fb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:49.160918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dd917-c51c-40e9-a120-c70845b794fb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:49.161022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dd917-c51c-40e9-a120-c70845b794fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:49.180792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-061dd917-c51c-40e9-a120-c70845b794fb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:07:49.182189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-061dd917-c51c-40e9-a120-c70845b794fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:49.189880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:07:49.496571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb19a67-bc70-479c-840d-c496bca3ce67 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:07:49.498286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8fb19a67-bc70-479c-840d-c496bca3ce67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:07:49.505866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:49.511871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb19a67-bc70-479c-840d-c496bca3ce67 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:07:49.515483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdecbe-7efc-49d2-ba66-e29bc43cf0fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:07:49.521259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdecbe-7efc-49d2-ba66-e29bc43cf0fb service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:07:49.521259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdecbe-7efc-49d2-ba66-e29bc43cf0fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:07:49.521259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdecbe-7efc-49d2-ba66-e29bc43cf0fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:07:49.525539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdecbe-7efc-49d2-ba66-e29bc43cf0fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:07:49.527010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdecbe-7efc-49d2-ba66-e29bc43cf0fb service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:07:49.536327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 774/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:07:59.175469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=11 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:07:59.537190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:16.155357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad0be-ad70-444f-a5e2-6a798a2f3ad9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.156011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad0be-ad70-444f-a5e2-6a798a2f3ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.156011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ad0be-ad70-444f-a5e2-6a798a2f3ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.179131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-517ad0be-ad70-444f-a5e2-6a798a2f3ad9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.180757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-517ad0be-ad70-444f-a5e2-6a798a2f3ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.196739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 766/1540] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.206666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5487d3-c7ef-4e28-a2f0-d9ab643dc643 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.207276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5487d3-c7ef-4e28-a2f0-d9ab643dc643 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.207276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5487d3-c7ef-4e28-a2f0-d9ab643dc643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.233266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bf5487d3-c7ef-4e28-a2f0-d9ab643dc643 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.234496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bf5487d3-c7ef-4e28-a2f0-d9ab643dc643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.243734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 775/1541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.249118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad0be-ad70-444f-a5e2-6a798a2f3ad9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:16.259732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ad0be-ad70-444f-a5e2-6a798a2f3ad9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:16.270094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148744-c76b-4701-956d-17e3420fadc0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.270406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148744-c76b-4701-956d-17e3420fadc0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.270650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f148744-c76b-4701-956d-17e3420fadc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.271984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:16.272865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.273382 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.273920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.274827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:16.275629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:16.278691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:16.298231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 767/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:09:16.307053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6f148744-c76b-4701-956d-17e3420fadc0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.309258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6f148744-c76b-4701-956d-17e3420fadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.318384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 776/1543] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:09:16.322487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:16.333819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdd424-2c45-4640-a5cb-d67d6228fb36 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:16.335581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb9ed-a059-4101-97bd-7c028cd78774 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.336980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb9ed-a059-4101-97bd-7c028cd78774 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.337499 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb9ed-a059-4101-97bd-7c028cd78774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.347063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bde073-8bbe-4465-9452-dd9d2eb9238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:16.348358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bde073-8bbe-4465-9452-dd9d2eb9238b admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.349925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bde073-8bbe-4465-9452-dd9d2eb9238b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.350470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bde073-8bbe-4465-9452-dd9d2eb9238b admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.352539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bde073-8bbe-4465-9452-dd9d2eb9238b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:16.355917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-99bde073-8bbe-4465-9452-dd9d2eb9238b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:09:16.355917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:09:16.355917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:09:16.358270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bde073-8bbe-4465-9452-dd9d2eb9238b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:16.384260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e5bbb9ed-a059-4101-97bd-7c028cd78774 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.388045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e5bbb9ed-a059-4101-97bd-7c028cd78774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.402349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 777/1544] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.406916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbb9ed-a059-4101-97bd-7c028cd78774 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:16.420670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbb9ed-a059-4101-97bd-7c028cd78774 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:16.426887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:16.431715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.431715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.431715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.431715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:16.431715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:16.432792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:09:16.432792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: warnings.warn(msg) Oct 03 16:09:16.432792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: Oct 03 16:09:16.432792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144a3f6-a8f2-4960-a072-ecdc68d9a172 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:16.454278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 778/1545] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:16.455548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd3e50-7d8f-44c9-baa6-0c89dbdc1f5b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.455828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd3e50-7d8f-44c9-baa6-0c89dbdc1f5b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.456344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd3e50-7d8f-44c9-baa6-0c89dbdc1f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.487601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5ebd3e50-7d8f-44c9-baa6-0c89dbdc1f5b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.488836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5ebd3e50-7d8f-44c9-baa6-0c89dbdc1f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.501575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 779/1546] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.502771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd3e50-7d8f-44c9-baa6-0c89dbdc1f5b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:16.527002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 768/1547] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:16.528615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd3e50-7d8f-44c9-baa6-0c89dbdc1f5b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:16.529106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b738-488a-497f-8c19-776c7c62fb92 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.529736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b738-488a-497f-8c19-776c7c62fb92 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.530359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b738-488a-497f-8c19-776c7c62fb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.579237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-baf1b738-488a-497f-8c19-776c7c62fb92 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.583227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-baf1b738-488a-497f-8c19-776c7c62fb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.672863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389688d-e313-46ba-87d7-a0c5cc6645b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:16.673472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389688d-e313-46ba-87d7-a0c5cc6645b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.673699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389688d-e313-46ba-87d7-a0c5cc6645b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.674064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389688d-e313-46ba-87d7-a0c5cc6645b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.675165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389688d-e313-46ba-87d7-a0c5cc6645b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:16.676840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389688d-e313-46ba-87d7-a0c5cc6645b0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:16.741064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 769/1548] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.742554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da99bc-6bb2-4c1e-a0a1-b1a897db0dc9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.742843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da99bc-6bb2-4c1e-a0a1-b1a897db0dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.743116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da99bc-6bb2-4c1e-a0a1-b1a897db0dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.772639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-01da99bc-6bb2-4c1e-a0a1-b1a897db0dc9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.774228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-01da99bc-6bb2-4c1e-a0a1-b1a897db0dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.783005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 770/1549] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.791039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da99bc-6bb2-4c1e-a0a1-b1a897db0dc9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:16.796367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da99bc-6bb2-4c1e-a0a1-b1a897db0dc9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:16.796684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 780/1550] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/projects => generated 365 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:16.798308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ac90-4950-4ded-a7d0-7958a5241f19 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.798729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ac90-4950-4ded-a7d0-7958a5241f19 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.799017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ac90-4950-4ded-a7d0-7958a5241f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.850410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4180ac90-4950-4ded-a7d0-7958a5241f19 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.854166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4180ac90-4950-4ded-a7d0-7958a5241f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.880059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:16.880680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.880964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.881242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.881949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:16.883861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:16.919774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 781/1551] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.921100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d874d-009b-437f-bcd8-e0e2ce8b209a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.921390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d874d-009b-437f-bcd8-e0e2ce8b209a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.921666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d874d-009b-437f-bcd8-e0e2ce8b209a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.941120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 771/1552] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:16.942056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-435d874d-009b-437f-bcd8-e0e2ce8b209a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:16.943253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-435d874d-009b-437f-bcd8-e0e2ce8b209a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:16.944838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:16.952674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 782/1553] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:16.953517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d874d-009b-437f-bcd8-e0e2ce8b209a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:16.955291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d05f-b737-4747-a318-1a39006fae68 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:16.960198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9095187-4c2f-4a97-9a72-62f1128aa31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:16.960828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095187-4c2f-4a97-9a72-62f1128aa31e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.961107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095187-4c2f-4a97-9a72-62f1128aa31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.961377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9095187-4c2f-4a97-9a72-62f1128aa31e admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.962220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095187-4c2f-4a97-9a72-62f1128aa31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:16.962544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095187-4c2f-4a97-9a72-62f1128aa31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:16.963282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d874d-009b-437f-bcd8-e0e2ce8b209a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:16.964242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9095187-4c2f-4a97-9a72-62f1128aa31e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:16.968527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6bcca-6ed1-47a8-ab10-9f681b381e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:16.969175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6bcca-6ed1-47a8-ab10-9f681b381e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.969458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6bcca-6ed1-47a8-ab10-9f681b381e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.969731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6bcca-6ed1-47a8-ab10-9f681b381e77 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.970392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6bcca-6ed1-47a8-ab10-9f681b381e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:16.971400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-86b6bcca-6ed1-47a8-ab10-9f681b381e77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:09:16.971400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: warnings.warn(msg) Oct 03 16:09:16.971400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: Oct 03 16:09:16.972630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6bcca-6ed1-47a8-ab10-9f681b381e77 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:16.976644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 772/1554] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:16.977831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd85474-2e3d-4a7c-a41a-6038d57bca28 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:16.978116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd85474-2e3d-4a7c-a41a-6038d57bca28 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:16.978389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd85474-2e3d-4a7c-a41a-6038d57bca28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:16.998854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cdd85474-2e3d-4a7c-a41a-6038d57bca28 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:17.000030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cdd85474-2e3d-4a7c-a41a-6038d57bca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:17.007811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 773/1555] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:17.008947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788506a9-51e9-4f9c-858a-6390cc63142d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.009227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788506a9-51e9-4f9c-858a-6390cc63142d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.009497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788506a9-51e9-4f9c-858a-6390cc63142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.033171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-788506a9-51e9-4f9c-858a-6390cc63142d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:17.034408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-788506a9-51e9-4f9c-858a-6390cc63142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:17.041377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 783/1556] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:16 2022] POST /identity/v3/users => generated 283 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:17.041377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479526-e67b-4135-af24-eca5c2d035cf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.041377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479526-e67b-4135-af24-eca5c2d035cf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.041377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d479526-e67b-4135-af24-eca5c2d035cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.043197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 774/1557] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:17.044331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400d40b-0c69-47d6-89b2-603cfe4e9a8b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.044614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400d40b-0c69-47d6-89b2-603cfe4e9a8b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.044887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400d40b-0c69-47d6-89b2-603cfe4e9a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.059816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:17.064387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0d479526-e67b-4135-af24-eca5c2d035cf None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:17.065498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5400d40b-0c69-47d6-89b2-603cfe4e9a8b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:17.065628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0d479526-e67b-4135-af24-eca5c2d035cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:17.066740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5400d40b-0c69-47d6-89b2-603cfe4e9a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:17.073598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 784/1558] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:17.075271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 775/1559] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:17.076057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400d40b-0c69-47d6-89b2-603cfe4e9a8b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.078897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479526-e67b-4135-af24-eca5c2d035cf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.086173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400d40b-0c69-47d6-89b2-603cfe4e9a8b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.090773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d479526-e67b-4135-af24-eca5c2d035cf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.092352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.092947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.093227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.093501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.094214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:17.100808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.100984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2312bc-b8e9-421e-a7bf-42ef2d1741fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.101116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.101218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2312bc-b8e9-421e-a7bf-42ef2d1741fc admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.101218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2312bc-b8e9-421e-a7bf-42ef2d1741fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.101218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2312bc-b8e9-421e-a7bf-42ef2d1741fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.101218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2312bc-b8e9-421e-a7bf-42ef2d1741fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.101218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2312bc-b8e9-421e-a7bf-42ef2d1741fc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.108599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 776/1560] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:17.109476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.113609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 785/1561] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:17.113609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b811bf8-c27a-49a6-ae45-5b8b22835386 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.113609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b811bf8-c27a-49a6-ae45-5b8b22835386 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.113609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b811bf8-c27a-49a6-ae45-5b8b22835386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.121922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:17.122088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e45a19-c2d7-4094-8869-fbd6610ecb87 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.126479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.127088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.127372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.127976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.128307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.130267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.135428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0b811bf8-c27a-49a6-ae45-5b8b22835386 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:17.135428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0b811bf8-c27a-49a6-ae45-5b8b22835386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:17.141928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 786/1562] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:17.146232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b811bf8-c27a-49a6-ae45-5b8b22835386 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.156532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b811bf8-c27a-49a6-ae45-5b8b22835386 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.161207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b74e12-7c4d-4d77-a178-f754ec400a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.161827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74e12-7c4d-4d77-a178-f754ec400a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.162119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74e12-7c4d-4d77-a178-f754ec400a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.162433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74e12-7c4d-4d77-a178-f754ec400a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.163061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b74e12-7c4d-4d77-a178-f754ec400a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.164709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b74e12-7c4d-4d77-a178-f754ec400a8b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.175047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 787/1563] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:17.176220 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee902c9-2a8d-4620-b924-58c47aecddea None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.176512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee902c9-2a8d-4620-b924-58c47aecddea None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.176806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee902c9-2a8d-4620-b924-58c47aecddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.193954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 777/1564] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:17.194861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.196666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bee902c9-2a8d-4620-b924-58c47aecddea None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:17.197994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bee902c9-2a8d-4620-b924-58c47aecddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:17.256432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 788/1565] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:17.257132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220340-4a2a-4bce-8cc0-0bca7a2791aa admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.257715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636d6b8-84bd-47ab-a262-d63ff0aef031 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.257977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636d6b8-84bd-47ab-a262-d63ff0aef031 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.258250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636d6b8-84bd-47ab-a262-d63ff0aef031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.265442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.266095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.266375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.266649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.267292 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:17.267594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.269177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.279362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1636d6b8-84bd-47ab-a262-d63ff0aef031 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:17.280737 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1636d6b8-84bd-47ab-a262-d63ff0aef031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:17.282905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 778/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:17.283831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.288768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 789/1567] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:17.289426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636d6b8-84bd-47ab-a262-d63ff0aef031 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.294755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541f4c-0f0b-48fb-871d-e20e05a04039 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.299347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.299939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.300223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.300500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.301129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.302479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636d6b8-84bd-47ab-a262-d63ff0aef031 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.302757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.306988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.307675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.307951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.308225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.308848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.310810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.313851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 779/1568] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:17.314718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.325660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa649e96-888e-4251-84f4-8449bc5d7b16 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.331056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.331639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.331915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.332183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.332809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:17.333106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.334694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.346797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 780/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:17.347566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.357330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee2cd-3fad-4a93-91e4-d45f4e6da526 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.361921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.362494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.362774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.363043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.363669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.365293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.380652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 781/1570] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:17.381476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.391517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33860dea-9f01-4a04-828a-eb863a4a2485 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.396058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.396629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.396910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.397183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.397821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.399696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.412788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 790/1571] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:17.412788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.472984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978b199-f355-4c28-b1cf-b4bb706e82ef admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.477705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.478328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.478608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.478878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.479616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:17.480050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.481619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.492531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 782/1572] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:17.492531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.503982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 791/1573] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:17.503982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.504191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4d6b-519b-48ec-9bae-7b1d96ff53b8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.505649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.506288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.506598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.506873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.507502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.509235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c02ef7-deae-40d7-91f8-3d42cba36c4d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.509494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.514490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.515079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.515355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.515627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.516289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:17.516565 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.518171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.530598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 792/1574] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:17.531377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.540393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe3a67-5eb7-4205-9cd0-e12c07923ce4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.545339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.546006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.546285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.546555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] PATH_INFO: `/v3/projects/fe375d9f6def406ca33fac0337bcd636/users/a7356e1101a14bc7a7a9d0565461c318/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.561241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe375d9f6def406ca33fac0337bcd636, user_id=a7356e1101a14bc7a7a9d0565461c318, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.564326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.605669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 783/1575] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:17.607199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.632157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 793/1576] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:17 2022] PUT /identity/v3/projects/fe375d9f6def406ca33fac0337bcd636/users/a7356e1101a14bc7a7a9d0565461c318/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:17.636617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.651500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:17.658344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:17.674942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbb3a6-1a2e-414c-8e24-1ff62f8cedd1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.695968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a956b5-5d11-42a0-b848-c59fb6ef8f6e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.701722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.702473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.702758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.703030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] PATH_INFO: `/v3/projects/d782fef5708043958ba5a448cf858e8c/users/65da2dd753a740d0b4e2434d72242ac5/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.717849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d782fef5708043958ba5a448cf858e8c, user_id=65da2dd753a740d0b4e2434d72242ac5, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.720613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.736042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.736656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.736934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.737204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.737870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.739775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.827158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 794/1577] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:17 2022] PUT /identity/v3/projects/d782fef5708043958ba5a448cf858e8c/users/65da2dd753a740d0b4e2434d72242ac5/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:17.828055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.854606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 784/1578] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/projects => generated 355 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:17.854606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.895113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3601656-fc8c-40b7-a12a-617e43fb2587 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.916840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd3a6e-e673-44f6-8f6a-0f4542ce7809 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.921624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.922258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.922563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.922834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.923474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.925177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.935767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 785/1579] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:17.936348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:17.945681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf50d-32b3-4885-868f-61a144174718 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:17.950698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.951283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.951402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:17.951566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.951842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.951956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:17.952222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:17.952461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.952563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:17.953136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:17.954426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:17.955086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.061896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 795/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.062638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.073020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69322e23-b976-4046-a568-7e93b3f2d6d3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.077655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845226-cf86-4b03-8803-1e6d9534fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.078278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845226-cf86-4b03-8803-1e6d9534fb7e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.078557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845226-cf86-4b03-8803-1e6d9534fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.078853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845226-cf86-4b03-8803-1e6d9534fb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.079480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845226-cf86-4b03-8803-1e6d9534fb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.081351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845226-cf86-4b03-8803-1e6d9534fb7e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.091823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 786/1581] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:17 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.093137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.146206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:18.157318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a591-bee7-42fa-863d-9843ad90c568 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.161984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920dfb2-8a50-4acf-a425-f3e102c3b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.162582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920dfb2-8a50-4acf-a425-f3e102c3b8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.162857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920dfb2-8a50-4acf-a425-f3e102c3b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.163128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920dfb2-8a50-4acf-a425-f3e102c3b8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.163749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920dfb2-8a50-4acf-a425-f3e102c3b8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.165644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920dfb2-8a50-4acf-a425-f3e102c3b8c6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.183024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 796/1582] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.187015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f63da-299b-408c-86f6-cd7e6753fe46 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.187015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f63da-299b-408c-86f6-cd7e6753fe46 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.187015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f63da-299b-408c-86f6-cd7e6753fe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.204108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f42f63da-299b-408c-86f6-cd7e6753fe46 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:18.209570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f42f63da-299b-408c-86f6-cd7e6753fe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:18.214037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:18.250959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 787/1583] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.252351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bae1a-5659-4768-ba0b-b2b036b4f2dc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.252614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bae1a-5659-4768-ba0b-b2b036b4f2dc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.252926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bae1a-5659-4768-ba0b-b2b036b4f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.266726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 797/1584] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:18.267545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f63da-299b-408c-86f6-cd7e6753fe46 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.276887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f63da-299b-408c-86f6-cd7e6753fe46 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.281657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.282326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.282609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.282901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.283676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.285670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.299174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-961bae1a-5659-4768-ba0b-b2b036b4f2dc None None] MFA Rules not processed for user `65da2dd753a740d0b4e2434d72242ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:18.300403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-961bae1a-5659-4768-ba0b-b2b036b4f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:18.363875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 798/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/users => generated 278 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.367015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 788/1586] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:18.367129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bae1a-5659-4768-ba0b-b2b036b4f2dc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.368135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.378361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52846df1-b43b-4d96-ad3e-c9d7538fec05 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.378707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bae1a-5659-4768-ba0b-b2b036b4f2dc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.382991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.383199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.383593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.383798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.383923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.384098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.384204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.384370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.384766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.385069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.386561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.386817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.400226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 789/1587] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.400226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.400483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 799/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.400483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.414402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69cf25-e5c7-49ab-a92e-c0df1e03754d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.414595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aa7ff-c5f0-48ec-9e59-f099b6eb05f0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.420127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.420730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.420872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.421015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.421285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.421842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.422004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.422152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.422412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.423049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.423909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.424989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.516900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 800/1589] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.517784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.527563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a782744-db94-4ba0-a0b6-aa0698c62a64 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.532421 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.532988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.533265 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.533534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.534232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.535842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.549403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 801/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.549403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.549714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 790/1591] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.549714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.559877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae6900-489f-4649-bc20-2f9ce7ce34b9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.564439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.565032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.565314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.565589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.566251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.567847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.579181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 791/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.579959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.590369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16259265-a71d-409e-8930-33595eb8c62a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.594935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.595527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.595811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.596088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.596715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.598928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.612461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc2c41-b0e8-48d1-947e-e1a3b4411fa2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.616271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.616972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.617319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.617656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.627352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.628763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.638471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 802/1593] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:18.639309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.648003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f2f3c-5423-4515-af66-1a6a80593679 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.653712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.654386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.655040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.655040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] PATH_INFO: `/v3/projects/915a41331fd64a6e949b1ebe5b8ade10/users/47da043ec00e4b1d873267c39d0abcea/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.674037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=915a41331fd64a6e949b1ebe5b8ade10, user_id=47da043ec00e4b1d873267c39d0abcea, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.675124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 792/1594] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.675648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.677144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.745646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558cecc-4217-451e-9a30-7846eda7a3f6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.750306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.750917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.751202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.751477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.752120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.753733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.766927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 803/1595] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:18 2022] PUT /identity/v3/projects/915a41331fd64a6e949b1ebe5b8ade10/users/47da043ec00e4b1d873267c39d0abcea/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:18.766927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.771314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 793/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.771314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.775581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:18.780601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4e1a1-f3ec-455c-999d-8a8f7433270a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.812518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:18.835541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a67df-c5be-48cf-9537-7dfe977b9339 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.840418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.841043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.841339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.841483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.841614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.842079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.842343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.842456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.842623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.843249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.843951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.844835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.855088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 804/1597] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.855931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.856115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 794/1598] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.859874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.866244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994a410-d7b3-4e6c-9586-1a9418f8ce5a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.869194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1dc69-255a-4d2f-8d1d-a1d2fd9fdc78 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.871156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.871764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.872045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.872384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.872967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.873886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eccb95-8611-4aa0-8c1d-a81b16cac65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.874472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eccb95-8611-4aa0-8c1d-a81b16cac65b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.874613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.874749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eccb95-8611-4aa0-8c1d-a81b16cac65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.875023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eccb95-8611-4aa0-8c1d-a81b16cac65b admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.875647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eccb95-8611-4aa0-8c1d-a81b16cac65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.877214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eccb95-8611-4aa0-8c1d-a81b16cac65b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.885796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 805/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.886585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.891107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 795/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:18.891107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729e4d-b9ac-422f-b84a-1b7f543ec048 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.891107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729e4d-b9ac-422f-b84a-1b7f543ec048 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.891107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d729e4d-b9ac-422f-b84a-1b7f543ec048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.896486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad04405-3670-46f8-8b4f-97c5aa05075d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.902502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.903113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.903400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.903678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.904314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.906305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.911190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3d729e4d-b9ac-422f-b84a-1b7f543ec048 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:18.912572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3d729e4d-b9ac-422f-b84a-1b7f543ec048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:18.921464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 796/1601] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:18.922289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d729e4d-b9ac-422f-b84a-1b7f543ec048 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:18.931947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d729e4d-b9ac-422f-b84a-1b7f543ec048 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:18.937329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:18.938067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:18.938351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:18.938634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] PATH_INFO: `/v3/projects/714fc3bb849f49cfbb622c7ef1f92443/users/6e93bd4c42014ccd82e8277aae7dcc01/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:18.955465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714fc3bb849f49cfbb622c7ef1f92443, user_id=6e93bd4c42014ccd82e8277aae7dcc01, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:18.956558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:09:18.956558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:09:18.956558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:09:18.958554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:18.991261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 806/1602] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:18 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:18.992293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.002619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e166aa6-17ac-41e9-83e6-46d27f710c3b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.007795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.008425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.008707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.008985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.009698 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.012767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.016943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 797/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:18 2022] PUT /identity/v3/projects/714fc3bb849f49cfbb622c7ef1f92443/users/6e93bd4c42014ccd82e8277aae7dcc01/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:19.017574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.032392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 807/1604] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:19.032392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.040361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4cf6d-57cb-4768-8e54-9d52d607b17e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.090882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114d635-baf7-4e07-bda5-7b3f5672ba72 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.095723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.096417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.096696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.096970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] PATH_INFO: `/v3/projects/d6de144301e641fda8b458b8cebfa887/users/81b68eda0eb445309b4c76ef2aeae190/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.100264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.101126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.101126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.101445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.102048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.103637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.112943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6de144301e641fda8b458b8cebfa887, user_id=81b68eda0eb445309b4c76ef2aeae190, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.114346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 808/1605] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:19.115147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.121532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.125694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797c912-8a60-4b9b-9c0f-4528f76e06e0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.130671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.131471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.131764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.132046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] PATH_INFO: `/v3/projects/d30630add77e4cceb7140feb0663ca03/users/2348471d0ee04cf582952db2681d4b1b/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.147668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30630add77e4cceb7140feb0663ca03, user_id=2348471d0ee04cf582952db2681d4b1b, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.150422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.198788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 798/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:19 2022] PUT /identity/v3/projects/d6de144301e641fda8b458b8cebfa887/users/81b68eda0eb445309b4c76ef2aeae190/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:19.199640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.201241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:19.249755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:19.261874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 809/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:19 2022] PUT /identity/v3/projects/d30630add77e4cceb7140feb0663ca03/users/2348471d0ee04cf582952db2681d4b1b/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:19.261874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.270427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e9f11-52f0-4369-9319-b2391f3423ea admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.336987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf82a-ee2e-49e8-a332-b14c5b2529e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.337599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf82a-ee2e-49e8-a332-b14c5b2529e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.338025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf82a-ee2e-49e8-a332-b14c5b2529e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.338884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf82a-ee2e-49e8-a332-b14c5b2529e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.343724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2f5f9-cc01-465a-b8a6-036d011372d6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.348460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bf82a-ee2e-49e8-a332-b14c5b2529e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.348756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.349410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.349700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.349991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bf82a-ee2e-49e8-a332-b14c5b2529e1 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.350103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.350684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.352310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.358835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:19.363317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 799/1608] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:19.368557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 810/1609] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:19.368693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934a88-cea7-4aee-94ba-f8e48ba59876 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.368693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934a88-cea7-4aee-94ba-f8e48ba59876 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.368693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934a88-cea7-4aee-94ba-f8e48ba59876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.368961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.376257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8cd58f-8473-481f-a0de-e2c5cebd7346 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.382400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a142f-caf2-49dd-b8cf-4fa857a454dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.383001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a142f-caf2-49dd-b8cf-4fa857a454dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.383458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a142f-caf2-49dd-b8cf-4fa857a454dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.383724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a142f-caf2-49dd-b8cf-4fa857a454dc admin admin] PATH_INFO: `/v3/projects/9596f4a3476d4eec97d61f753ac4c42e/users/2bc96564e3244ead914551ea8a7a38c2/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.387088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-58934a88-cea7-4aee-94ba-f8e48ba59876 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:19.388553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-58934a88-cea7-4aee-94ba-f8e48ba59876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:19.400127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 800/1610] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:19.400127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58934a88-cea7-4aee-94ba-f8e48ba59876 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.402465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a142f-caf2-49dd-b8cf-4fa857a454dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9596f4a3476d4eec97d61f753ac4c42e, user_id=2bc96564e3244ead914551ea8a7a38c2, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.405299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a142f-caf2-49dd-b8cf-4fa857a454dc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.416565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58934a88-cea7-4aee-94ba-f8e48ba59876 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.420876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a2a2-34a2-405f-abba-094530afabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.421542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a2a2-34a2-405f-abba-094530afabaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.421866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a2a2-34a2-405f-abba-094530afabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.422256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a2a2-34a2-405f-abba-094530afabaa admin admin] PATH_INFO: `/v3/projects/ecab19d0600740f3ac46ee281dfc8876/users/bd5d01371a32435d90683a2c6e5e2e64/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.437243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811a2a2-34a2-405f-abba-094530afabaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecab19d0600740f3ac46ee281dfc8876, user_id=bd5d01371a32435d90683a2c6e5e2e64, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.442996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811a2a2-34a2-405f-abba-094530afabaa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.483353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 811/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:19 2022] PUT /identity/v3/projects/9596f4a3476d4eec97d61f753ac4c42e/users/2bc96564e3244ead914551ea8a7a38c2/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:19.484836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf4a6-ce27-42b9-ba7e-d41a18576ed1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.485311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf4a6-ce27-42b9-ba7e-d41a18576ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.485648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf4a6-ce27-42b9-ba7e-d41a18576ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.511807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4e8cf4a6-ce27-42b9-ba7e-d41a18576ed1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:19.513134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e8cf4a6-ce27-42b9-ba7e-d41a18576ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:19.529433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 801/1612] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:19 2022] PUT /identity/v3/projects/ecab19d0600740f3ac46ee281dfc8876/users/bd5d01371a32435d90683a2c6e5e2e64/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:19.531224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ad99-fa84-43ef-bbd1-2cc9fffed5e2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.531929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ad99-fa84-43ef-bbd1-2cc9fffed5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.532110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ad99-fa84-43ef-bbd1-2cc9fffed5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.572221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7301ad99-fa84-43ef-bbd1-2cc9fffed5e2 None None] MFA Rules not processed for user `2348471d0ee04cf582952db2681d4b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:19.573954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7301ad99-fa84-43ef-bbd1-2cc9fffed5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:19.590825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 812/1613] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:19.594255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cf4a6-ce27-42b9-ba7e-d41a18576ed1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.604493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cf4a6-ce27-42b9-ba7e-d41a18576ed1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.658243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 802/1614] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:19.659511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ad99-fa84-43ef-bbd1-2cc9fffed5e2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.673108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761e5d8-8a5c-44b9-b8ac-182e75eb1ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.673887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761e5d8-8a5c-44b9-b8ac-182e75eb1ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.678664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761e5d8-8a5c-44b9-b8ac-182e75eb1ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.678664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761e5d8-8a5c-44b9-b8ac-182e75eb1ef0 admin admin] PATH_INFO: `/v3/projects/c2fc5d23412e43218c90be403c66b2b7/users/a6fbdd176af84d9983dfc97340c8b298/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.690899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761e5d8-8a5c-44b9-b8ac-182e75eb1ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fc5d23412e43218c90be403c66b2b7, user_id=a6fbdd176af84d9983dfc97340c8b298, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.693912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761e5d8-8a5c-44b9-b8ac-182e75eb1ef0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.725517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ad99-fa84-43ef-bbd1-2cc9fffed5e2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.733677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024fc4f-a05b-422d-8560-f3508857b4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.744183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024fc4f-a05b-422d-8560-f3508857b4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.744183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024fc4f-a05b-422d-8560-f3508857b4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.744183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024fc4f-a05b-422d-8560-f3508857b4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.752760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024fc4f-a05b-422d-8560-f3508857b4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:19.754424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024fc4f-a05b-422d-8560-f3508857b4b0 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:19.764551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 803/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:19.765955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68111496-c6d3-4f88-b93d-ff627370962d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.766419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68111496-c6d3-4f88-b93d-ff627370962d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.766605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68111496-c6d3-4f88-b93d-ff627370962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.773452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:19.799551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-68111496-c6d3-4f88-b93d-ff627370962d None None] MFA Rules not processed for user `2bc96564e3244ead914551ea8a7a38c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:19.800779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-68111496-c6d3-4f88-b93d-ff627370962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:19.806373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 813/1616] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:19 2022] PUT /identity/v3/projects/c2fc5d23412e43218c90be403c66b2b7/users/a6fbdd176af84d9983dfc97340c8b298/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:19.806373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f64792-6577-40c1-9135-1dd459bcdfc4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.806373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f64792-6577-40c1-9135-1dd459bcdfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.806373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f64792-6577-40c1-9135-1dd459bcdfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:19.844811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-06f64792-6577-40c1-9135-1dd459bcdfc4 None None] MFA Rules not processed for user `bd5d01371a32435d90683a2c6e5e2e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:19.846454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-06f64792-6577-40c1-9135-1dd459bcdfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:19.883319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 804/1617] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:19.884232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68111496-c6d3-4f88-b93d-ff627370962d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.920563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:19.949847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 814/1618] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:19.952386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f64792-6577-40c1-9135-1dd459bcdfc4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:19.981825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68111496-c6d3-4f88-b93d-ff627370962d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:19.985746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:19.986526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:19.986887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:19.987235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.035794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f64792-6577-40c1-9135-1dd459bcdfc4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.040948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.042377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.042763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.043142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.043889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.047183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.065935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.067786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.081023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 805/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:20.082265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.094343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5e744-7f35-4e58-b19d-2df7ca1eeb30 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.100922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcb594-4378-4318-8b38-8ce0bf6953c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.101597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb594-4378-4318-8b38-8ce0bf6953c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.101962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb594-4378-4318-8b38-8ce0bf6953c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.102243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb594-4378-4318-8b38-8ce0bf6953c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.102966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcb594-4378-4318-8b38-8ce0bf6953c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.104844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcb594-4378-4318-8b38-8ce0bf6953c4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.125754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 806/1620] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:20.125754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85240da2-d120-49d9-a3a2-0d48f0ed7385 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.125754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85240da2-d120-49d9-a3a2-0d48f0ed7385 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.125754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85240da2-d120-49d9-a3a2-0d48f0ed7385 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.131354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 807/1621] 10.222.0.26 () {54 vars in 961 bytes} [Mon Oct 3 16:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:20.131354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85240da2-d120-49d9-a3a2-0d48f0ed7385 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.148736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85240da2-d120-49d9-a3a2-0d48f0ed7385 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.154873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.155778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.156224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.156646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.158466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.164315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.164489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 815/1622] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:19 2022] POST /identity/v3/projects => generated 357 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:20.164489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.253429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0044-7201-4dbf-941a-69d9125af1c3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.258172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddd736-611d-4dc0-933f-f9ebf1e54a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.258830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd736-611d-4dc0-933f-f9ebf1e54a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.259112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd736-611d-4dc0-933f-f9ebf1e54a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.259397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddd736-611d-4dc0-933f-f9ebf1e54a69 admin admin] PATH_INFO: `/v3/projects/c2fc5d23412e43218c90be403c66b2b7/users/a6fbdd176af84d9983dfc97340c8b298/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.262261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddd736-611d-4dc0-933f-f9ebf1e54a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fc5d23412e43218c90be403c66b2b7, user_id=a6fbdd176af84d9983dfc97340c8b298, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.265603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acddd736-611d-4dc0-933f-f9ebf1e54a69 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.289241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 816/1623] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:20 2022] PUT /identity/v3/projects/c2fc5d23412e43218c90be403c66b2b7/users/a6fbdd176af84d9983dfc97340c8b298/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:20.289241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2ae0-919e-4637-bf6a-4f6f226e9db1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.289241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2ae0-919e-4637-bf6a-4f6f226e9db1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.289241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2ae0-919e-4637-bf6a-4f6f226e9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.343558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c64b2ae0-919e-4637-bf6a-4f6f226e9db1 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:20.343558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c64b2ae0-919e-4637-bf6a-4f6f226e9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:20.347629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 808/1624] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:20 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:20.349522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.364842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:20.465992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa32eb7-c350-42e2-ad2a-9de6df5e81f1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.471627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.472369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.472745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.473379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.474159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.477261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.506729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 817/1625] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Oct 3 16:09:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:20.508216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85f615-3578-450a-967a-4c70f542b5b3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.509291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85f615-3578-450a-967a-4c70f542b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.509700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85f615-3578-450a-967a-4c70f542b5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.525395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:20.548993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3a85f615-3578-450a-967a-4c70f542b5b3 None None] MFA Rules not processed for user `a6fbdd176af84d9983dfc97340c8b298`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:20.550344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3a85f615-3578-450a-967a-4c70f542b5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:20.576311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 809/1626] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:20 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:20.580615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.593698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecf460-89e7-4f19-ba70-d5dcd2323e73 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.599252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.601840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.601840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.601840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.601840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.605301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.699953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 818/1627] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:20.700905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85f615-3578-450a-967a-4c70f542b5b3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.726061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85f615-3578-450a-967a-4c70f542b5b3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.733471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.734138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.734424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.734703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.751053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 810/1628] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:20 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:20.757522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.785975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d06f3-88ce-471b-a247-f58a216492cf admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.800012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.801710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.801710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.801710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.802746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.805134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.830487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.832430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.843772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 811/1629] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:20.845947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.851154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 819/1630] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:20.852202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.869436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264efa6-6ecb-4cb6-bdac-c8fbedcae990 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.876213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.876964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.877323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.877671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.878473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.881585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.896839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 820/1631] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:20.897854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.915546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73302d1-3152-4286-9edd-6a143e079892 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.919364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2a06a-b35f-4f38-b762-55f096c423c7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.921661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.923625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.923796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.930851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.930995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.931135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] PATH_INFO: `/v3/projects/190d7f35b0f94c069b2a97fcbfc8bbfa/users/f4c67472a7f74f3fb34f796b0b442454/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.931241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.931241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:20.936797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.938686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.944320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=190d7f35b0f94c069b2a97fcbfc8bbfa, user_id=f4c67472a7f74f3fb34f796b0b442454, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:20.948911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:20.951982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 812/1632] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:20.964856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:20.984682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9d1d5-4698-47d8-90a4-887410a34466 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:20.989704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:20.990465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:20.990794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:20.991006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] PATH_INFO: `/v3/projects/f55ec8ad9e104378a7faa5c1994928d9/users/9e5b81238f6d4028855df88077d42e00/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.007484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55ec8ad9e104378a7faa5c1994928d9, user_id=9e5b81238f6d4028855df88077d42e00, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:21.011384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:21.037669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 821/1633] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:20 2022] PUT /identity/v3/projects/190d7f35b0f94c069b2a97fcbfc8bbfa/users/f4c67472a7f74f3fb34f796b0b442454/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:21.043475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:21.121313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 813/1634] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:20 2022] PUT /identity/v3/projects/f55ec8ad9e104378a7faa5c1994928d9/users/9e5b81238f6d4028855df88077d42e00/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:21.123907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:21.196809 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8778-ba4f-4cdb-b769-672848577baa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:21.232614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9b75-3003-4025-b936-e71a617178a9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:21.241099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb415a55-63f4-4760-957d-713e82e32029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:21.243513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415a55-63f4-4760-957d-713e82e32029 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.243812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415a55-63f4-4760-957d-713e82e32029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.244095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415a55-63f4-4760-957d-713e82e32029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.246078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb415a55-63f4-4760-957d-713e82e32029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:21.247713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb415a55-63f4-4760-957d-713e82e32029 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:21.262913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 814/1635] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:21.264442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5711de-2018-45a3-a4ec-2b04e3409fac None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.264804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5711de-2018-45a3-a4ec-2b04e3409fac None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.265184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5711de-2018-45a3-a4ec-2b04e3409fac None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.267188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 815/1636] 10.222.0.26 () {54 vars in 912 bytes} [Mon Oct 3 16:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:21.271968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5711de-2018-45a3-a4ec-2b04e3409fac None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:21.279603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f7bb7-d136-4815-a6bc-3cdb2cdecbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:21.286838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7bb7-d136-4815-a6bc-3cdb2cdecbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.301725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7bb7-d136-4815-a6bc-3cdb2cdecbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.301725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f7bb7-d136-4815-a6bc-3cdb2cdecbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.301725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f7bb7-d136-4815-a6bc-3cdb2cdecbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:21.301725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f7bb7-d136-4815-a6bc-3cdb2cdecbc7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:21.302776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5711de-2018-45a3-a4ec-2b04e3409fac None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:21.308945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 822/1637] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:09:21.308945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e51b6-e10c-4ecd-b32c-57ceae5fcd38 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.308945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e51b6-e10c-4ecd-b32c-57ceae5fcd38 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.308945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e51b6-e10c-4ecd-b32c-57ceae5fcd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.309888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:21.310450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.310809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.311007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] PATH_INFO: `/v3/projects/f55ec8ad9e104378a7faa5c1994928d9/users/9e5b81238f6d4028855df88077d42e00/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.315121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55ec8ad9e104378a7faa5c1994928d9, user_id=9e5b81238f6d4028855df88077d42e00, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:21.321028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:21.340188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e70e51b6-e10c-4ecd-b32c-57ceae5fcd38 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:21.341626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e70e51b6-e10c-4ecd-b32c-57ceae5fcd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:21.347779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 816/1638] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:21 2022] PUT /identity/v3/projects/f55ec8ad9e104378a7faa5c1994928d9/users/9e5b81238f6d4028855df88077d42e00/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:21.358314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:21.451275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 823/1639] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:21.452297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e51b6-e10c-4ecd-b32c-57ceae5fcd38 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:21.477567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0b9e9-3f78-46ca-871a-a4fd342cef69 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:21.485254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b8fa2-2c57-47ac-952d-b17bff1cddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:21.486711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8fa2-2c57-47ac-952d-b17bff1cddc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.487487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8fa2-2c57-47ac-952d-b17bff1cddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.487860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8fa2-2c57-47ac-952d-b17bff1cddc8 admin admin] PATH_INFO: `/v3/projects/190d7f35b0f94c069b2a97fcbfc8bbfa/users/f4c67472a7f74f3fb34f796b0b442454/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.491093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b8fa2-2c57-47ac-952d-b17bff1cddc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190d7f35b0f94c069b2a97fcbfc8bbfa, user_id=f4c67472a7f74f3fb34f796b0b442454, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:21.495660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b8fa2-2c57-47ac-952d-b17bff1cddc8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:21.529443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 817/1640] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:21 2022] PUT /identity/v3/projects/190d7f35b0f94c069b2a97fcbfc8bbfa/users/f4c67472a7f74f3fb34f796b0b442454/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:21.529443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a6ca6-d809-40f1-983f-ee2220d3a1ff None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.529443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a6ca6-d809-40f1-983f-ee2220d3a1ff None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.529443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a6ca6-d809-40f1-983f-ee2220d3a1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.532556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:21.547844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e51b6-e10c-4ecd-b32c-57ceae5fcd38 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:21.560440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5b0a6ca6-d809-40f1-983f-ee2220d3a1ff None None] MFA Rules not processed for user `9e5b81238f6d4028855df88077d42e00`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:21.569890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5b0a6ca6-d809-40f1-983f-ee2220d3a1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:21.598800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:21.661969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 818/1641] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:21.667655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a6ca6-d809-40f1-983f-ee2220d3a1ff None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:21.670212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6ff3-9462-49a1-96f5-b08ddab32fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:21.671022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6ff3-9462-49a1-96f5-b08ddab32fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.671400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6ff3-9462-49a1-96f5-b08ddab32fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.671773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6ff3-9462-49a1-96f5-b08ddab32fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.684488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a6ca6-d809-40f1-983f-ee2220d3a1ff None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:21.690795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:21.698749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.698749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.698749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.970570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6ff3-9462-49a1-96f5-b08ddab32fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:21.970570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6ff3-9462-49a1-96f5-b08ddab32fa2 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:21.970570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 824/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:21.970570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845469d6-5d57-46cd-be0f-b2151752f3ee None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:21.970570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845469d6-5d57-46cd-be0f-b2151752f3ee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:21.970570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845469d6-5d57-46cd-be0f-b2151752f3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:21.983712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:21.983712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:21.983712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 819/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:21.991483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-845469d6-5d57-46cd-be0f-b2151752f3ee None None] MFA Rules not processed for user `f4c67472a7f74f3fb34f796b0b442454`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:21.992810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-845469d6-5d57-46cd-be0f-b2151752f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:22.162945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 825/1644] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:22.639775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:22.663886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d92de-c00e-49fa-b5a3-4543a5ff40ed service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:22.681599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:22.684804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:22.685130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:22.685491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:22.702321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:22.705355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:22.721256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 820/1645] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:22.769911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845469d6-5d57-46cd-be0f-b2151752f3ee None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:22.782430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845469d6-5d57-46cd-be0f-b2151752f3ee None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:22.797242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb3a1-82da-416d-b25f-1510462bad8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:22.798147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb3a1-82da-416d-b25f-1510462bad8c service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:22.798682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb3a1-82da-416d-b25f-1510462bad8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:22.799081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb3a1-82da-416d-b25f-1510462bad8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:22.825884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb3a1-82da-416d-b25f-1510462bad8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:22.827707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb3a1-82da-416d-b25f-1510462bad8c service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:22.857008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 826/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:22.975738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:23.043086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:23.377297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:23.387505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2542f-22c6-4dac-9bed-d0ad2e4e4565 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:23.392290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49e1eb-1226-4e65-bf06-b6979d1c3c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:23.393205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e1eb-1226-4e65-bf06-b6979d1c3c72 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:23.393624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e1eb-1226-4e65-bf06-b6979d1c3c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:23.394086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e1eb-1226-4e65-bf06-b6979d1c3c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:23.558771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e1eb-1226-4e65-bf06-b6979d1c3c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:23.560271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e1eb-1226-4e65-bf06-b6979d1c3c72 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:23.643588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 821/1647] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:23.807306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cee66-e7f1-43b9-aa24-dc5d0d23b4b3 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:23.807896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cee66-e7f1-43b9-aa24-dc5d0d23b4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:23.807896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cee66-e7f1-43b9-aa24-dc5d0d23b4b3 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:23.810738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 827/1648] 10.222.0.26 () {54 vars in 961 bytes} [Mon Oct 3 16:09:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:23.817646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262fd6b-5948-42ce-81e3-866550d9bb73 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:23.817994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262fd6b-5948-42ce-81e3-866550d9bb73 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:23.818282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262fd6b-5948-42ce-81e3-866550d9bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:23.847367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a262fd6b-5948-42ce-81e3-866550d9bb73 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:23.848915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a262fd6b-5948-42ce-81e3-866550d9bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:23.869805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 822/1649] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Oct 3 16:09:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:23.871271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dae46-d3de-4c57-b8fa-c7bf74816678 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:23.871697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dae46-d3de-4c57-b8fa-c7bf74816678 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:23.872688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dae46-d3de-4c57-b8fa-c7bf74816678 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:23.874817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 828/1650] 10.222.0.26 () {54 vars in 912 bytes} [Mon Oct 3 16:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:23.880433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79faa7-6b5b-4d69-ace7-551d9039c50e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:23.881473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79faa7-6b5b-4d69-ace7-551d9039c50e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:23.884887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79faa7-6b5b-4d69-ace7-551d9039c50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:23.913847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cc79faa7-6b5b-4d69-ace7-551d9039c50e None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:23.915958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cc79faa7-6b5b-4d69-ace7-551d9039c50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:23.940417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 823/1651] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:09:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:23.965664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dae46-d3de-4c57-b8fa-c7bf74816678 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:23.984118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dae46-d3de-4c57-b8fa-c7bf74816678 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:23.988925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:23.989579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:23.989907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:23.990374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:24.057850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:24.074488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:24.076147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:24.112262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 829/1652] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:24.276210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79faa7-6b5b-4d69-ace7-551d9039c50e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:24.296103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79faa7-6b5b-4d69-ace7-551d9039c50e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:24.312938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:24.313553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:24.313878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:24.314155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:24.332809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:24.334581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:24.384015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 824/1653] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:28.506428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:28.684787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de3947-edbb-42a3-94bc-44da79a51184 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:28.702328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:28.702992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:28.703275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:28.703555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] PATH_INFO: `/v3/users/65da2dd753a740d0b4e2434d72242ac5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:28.709301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65da2dd753a740d0b4e2434d72242ac5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:28.711577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:29.043269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65da2dd753a740d0b4e2434d72242ac5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.147248 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65da2dd753a740d0b4e2434d72242ac5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.165333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65da2dd753a740d0b4e2434d72242ac5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.166270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65da2dd753a740d0b4e2434d72242ac5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.202634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fec3eb9f-7912-459c-a5ee-1dd200cc88a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65da2dd753a740d0b4e2434d72242ac5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.214082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:29.216937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 830/1654] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:28 2022] DELETE /identity/v3/users/65da2dd753a740d0b4e2434d72242ac5 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:29.221625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:29.221974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:29.222257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:29.230813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3889b2-19c5-466e-b16a-21e600fafa4b service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:29.274942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:29.277585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:29.415392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 831/1655] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:29.423921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:29.424605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:29.424892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:29.425181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] PATH_INFO: `/v3/users/bd5d01371a32435d90683a2c6e5e2e64` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:29.434648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5d01371a32435d90683a2c6e5e2e64)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:29.436071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:09:29.436071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: warnings.warn(msg) Oct 03 16:09:29.436071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: Oct 03 16:09:29.440553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:29.455703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:29.458094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:29.487978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:29.646961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acde23a-c9f8-4b55-b0dd-536082078e85 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:29.663611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e78b67-b2a7-4ebb-bac3-47ebc50893c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:29.664664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78b67-b2a7-4ebb-bac3-47ebc50893c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:29.665086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78b67-b2a7-4ebb-bac3-47ebc50893c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:29.666087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e78b67-b2a7-4ebb-bac3-47ebc50893c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:29.691488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e78b67-b2a7-4ebb-bac3-47ebc50893c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:29.699263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e78b67-b2a7-4ebb-bac3-47ebc50893c7 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:29.710079 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 832/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:29.756925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:29.774077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5d01371a32435d90683a2c6e5e2e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.776121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5d01371a32435d90683a2c6e5e2e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.879771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5d01371a32435d90683a2c6e5e2e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.911709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5d01371a32435d90683a2c6e5e2e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.965336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5d01371a32435d90683a2c6e5e2e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:29.978354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 825/1657] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:29 2022] DELETE /identity/v3/users/bd5d01371a32435d90683a2c6e5e2e64 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:29.983480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e09054-5830-454a-bd0a-33c0915d3d34 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:29.983883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e09054-5830-454a-bd0a-33c0915d3d34 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:29.984256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e09054-5830-454a-bd0a-33c0915d3d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:30.014457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f1e09054-5830-454a-bd0a-33c0915d3d34 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:30.016407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f1e09054-5830-454a-bd0a-33c0915d3d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:30.153025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 833/1658] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:30.180716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:30.185713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:30.219885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:30.220683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:30.221492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:30.279570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] MFA Rules not processed for user `6e93bd4c42014ccd82e8277aae7dcc01`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:30.280809 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:30.328669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387f195-5a65-4a1a-8e48-d44496a367d4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:30.340854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915c4cd-08a5-42ba-8a8f-84901e1eb3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:30.341550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c4cd-08a5-42ba-8a8f-84901e1eb3fa service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:30.341863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c4cd-08a5-42ba-8a8f-84901e1eb3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:30.345896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c4cd-08a5-42ba-8a8f-84901e1eb3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:30.370659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915c4cd-08a5-42ba-8a8f-84901e1eb3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:30.376594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915c4cd-08a5-42ba-8a8f-84901e1eb3fa service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:30.415076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 826/1659] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:30.424117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 834/1660] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:09:30.426436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:30.429365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:30.429838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:30.471765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] MFA Rules not processed for user `6e93bd4c42014ccd82e8277aae7dcc01`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:30.474946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:30.492533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 827/1661] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:30.519760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:30.521349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:30.562650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:30.564076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:30.606555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41ab5f-7ebe-47a7-b614-81c7cf7bdcd1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:30.628043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:30.629264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:30.630003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:30.630003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] PATH_INFO: `/v3/users/2bc96564e3244ead914551ea8a7a38c2` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:30.636189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc96564e3244ead914551ea8a7a38c2)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:30.638396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:30.860920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581bb4c-e3cf-4ed6-81b3-8cb75869c472 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:30.894800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2012ff1-75cc-4a09-b4f6-14642141af2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:30.895932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2012ff1-75cc-4a09-b4f6-14642141af2f service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:30.896433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2012ff1-75cc-4a09-b4f6-14642141af2f service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:30.896954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2012ff1-75cc-4a09-b4f6-14642141af2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:30.910238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2012ff1-75cc-4a09-b4f6-14642141af2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:30.913922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2012ff1-75cc-4a09-b4f6-14642141af2f service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:30.929179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 835/1662] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:30.956648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc96564e3244ead914551ea8a7a38c2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:30.957525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc96564e3244ead914551ea8a7a38c2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:31.083520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc96564e3244ead914551ea8a7a38c2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:31.102399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc96564e3244ead914551ea8a7a38c2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:31.146597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc96564e3244ead914551ea8a7a38c2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:31.162364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 828/1663] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:30 2022] DELETE /identity/v3/users/2bc96564e3244ead914551ea8a7a38c2 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:31.168455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:31.168743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:31.169025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:31.257113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:31.263181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:31.439590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 836/1664] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:31.502911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:31.504954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:31.644182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:31.653014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a4e77-7675-49dc-a1a1-8a5aec8cd156 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:31.658058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:31.658763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:31.659051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:31.659332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:31.680578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:31.683075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:31.711732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 829/1665] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:31.999259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:32.059990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:32.061578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:32.078914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2ea3b-d788-4ba8-a7ed-6056eb5aea01 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:32.094645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:32.095991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:32.115562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:32.116203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:32.116486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:32.116761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] PATH_INFO: `/v3/projects/ecab19d0600740f3ac46ee281dfc8876` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:32.118534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c51e74-6b9b-4143-a230-801fc916cc45 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:32.125805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecab19d0600740f3ac46ee281dfc8876)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:32.130916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 16:09:32.130916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: warnings.warn(msg) Oct 03 16:09:32.130916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: Oct 03 16:09:32.136749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:32.137468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:32.138024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:32.138451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] PATH_INFO: `/v3/projects/d782fef5708043958ba5a448cf858e8c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:32.142358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d782fef5708043958ba5a448cf858e8c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:32.144614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:32.146822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:32.334673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd782fef5708043958ba5a448cf858e8c', 'request_id': 'req-51d41e41-82f0-4e22-a343-174a9bf3fadb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.345706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd782fef5708043958ba5a448cf858e8c', 'request_id': 'req-51d41e41-82f0-4e22-a343-174a9bf3fadb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.385960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd782fef5708043958ba5a448cf858e8c', 'request_id': 'req-51d41e41-82f0-4e22-a343-174a9bf3fadb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.439225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecab19d0600740f3ac46ee281dfc8876', 'request_id': 'req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.450291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecab19d0600740f3ac46ee281dfc8876', 'request_id': 'req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.467880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] The token cache is being invalidate because project d782fef5708043958ba5a448cf858e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:32.468458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.474007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-51d41e41-82f0-4e22-a343-174a9bf3fadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.477169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 830/1666] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:32 2022] DELETE /identity/v3/projects/d782fef5708043958ba5a448cf858e8c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:32.480272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3932-a41d-4661-9b73-6d20d8423bf1 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:32.480548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3932-a41d-4661-9b73-6d20d8423bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:32.480830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3932-a41d-4661-9b73-6d20d8423bf1 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:32.489291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 831/1667] 10.222.0.26 () {54 vars in 912 bytes} [Mon Oct 3 16:09:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:32.490568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d3932-a41d-4661-9b73-6d20d8423bf1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:32.495058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c39d3932-a41d-4661-9b73-6d20d8423bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:32.495349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecab19d0600740f3ac46ee281dfc8876', 'request_id': 'req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.584491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] The token cache is being invalidate because project ecab19d0600740f3ac46ee281dfc8876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:32.584754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.585953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4bdf86c4-b57c-4af2-b428-9787d5f3c7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:32.591392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 837/1668] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:32 2022] DELETE /identity/v3/projects/ecab19d0600740f3ac46ee281dfc8876 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:32.593498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:32.597298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:32.597754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:32.725647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] MFA Rules not processed for user `bf531e7741af49f091e1116ec1c6751c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:32.727134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:32.760363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d3932-a41d-4661-9b73-6d20d8423bf1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:32.771139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:32.773324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:32.773324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:32.773781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] PATH_INFO: `/v3/users/a6fbdd176af84d9983dfc97340c8b298` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:32.778144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6fbdd176af84d9983dfc97340c8b298)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:32.783430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:32.821804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:32.866720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 838/1669] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:09:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:32.867947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:32.870495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:32.908094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b41c7f-278f-4d6a-be55-d210552dcfdd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:32.915288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:32.916964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:32.917551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:32.918063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] PATH_INFO: `/v3/users/9e5b81238f6d4028855df88077d42e00` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:32.919554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5b81238f6d4028855df88077d42e00)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:32.923332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:33.059037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6fbdd176af84d9983dfc97340c8b298'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.062872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6fbdd176af84d9983dfc97340c8b298'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.168485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6fbdd176af84d9983dfc97340c8b298'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.194058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6fbdd176af84d9983dfc97340c8b298'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.220651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5b81238f6d4028855df88077d42e00'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.249385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6fbdd176af84d9983dfc97340c8b298'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.276568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 832/1670] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:32 2022] DELETE /identity/v3/users/a6fbdd176af84d9983dfc97340c8b298 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:33.276568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:33.286692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:33.364269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5b81238f6d4028855df88077d42e00'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.379959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5b81238f6d4028855df88077d42e00'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.380921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5b81238f6d4028855df88077d42e00'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.413485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5b81238f6d4028855df88077d42e00'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:33.429923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 839/1671] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:32 2022] DELETE /identity/v3/users/9e5b81238f6d4028855df88077d42e00 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:33.497201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa546-f14b-4b35-9ae1-79c4a532e657 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:33.526010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:33.581907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f95a-a97a-404e-b76b-0a576afd7fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:33.583001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f95a-a97a-404e-b76b-0a576afd7fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:33.583606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f95a-a97a-404e-b76b-0a576afd7fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:33.584063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f95a-a97a-404e-b76b-0a576afd7fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:33.586863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2e52f95a-a97a-404e-b76b-0a576afd7fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:33.599883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f95a-a97a-404e-b76b-0a576afd7fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:33.601914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f95a-a97a-404e-b76b-0a576afd7fa1 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:33.616318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 833/1672] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:33.939127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:33.942773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:34.019693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:34.020109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:34.020289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:34.097975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] MFA Rules not processed for user `a7356e1101a14bc7a7a9d0565461c318`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:34.100057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:34.156601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c40f0-552c-4dec-b43d-ec9e9f96c135 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:34.163261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c1036-598a-483e-a928-5495145377cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:34.164311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1036-598a-483e-a928-5495145377cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:34.164761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1036-598a-483e-a928-5495145377cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:34.165348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1036-598a-483e-a928-5495145377cf admin admin] PATH_INFO: `/v3/projects/9596f4a3476d4eec97d61f753ac4c42e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:34.169548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c1036-598a-483e-a928-5495145377cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9596f4a3476d4eec97d61f753ac4c42e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:34.173319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c1036-598a-483e-a928-5495145377cf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:34.261119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 834/1673] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:34.261119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:34.261707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:34.428687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-272c1036-598a-483e-a928-5495145377cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9596f4a3476d4eec97d61f753ac4c42e', 'request_id': 'req-272c1036-598a-483e-a928-5495145377cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:34.448984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-272c1036-598a-483e-a928-5495145377cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9596f4a3476d4eec97d61f753ac4c42e', 'request_id': 'req-272c1036-598a-483e-a928-5495145377cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:34.468860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-272c1036-598a-483e-a928-5495145377cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9596f4a3476d4eec97d61f753ac4c42e', 'request_id': 'req-272c1036-598a-483e-a928-5495145377cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:34.480728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:34.497336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35684f45-c5b6-4be3-bf71-7d9bdc9565d6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:34.590612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-272c1036-598a-483e-a928-5495145377cf admin admin] The token cache is being invalidate because project 9596f4a3476d4eec97d61f753ac4c42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:34.591879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-272c1036-598a-483e-a928-5495145377cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:34.592548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-272c1036-598a-483e-a928-5495145377cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:34.598030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 840/1674] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:33 2022] DELETE /identity/v3/projects/9596f4a3476d4eec97d61f753ac4c42e => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:34.605350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc1ca-0bd1-46b5-9610-6b81ee417228 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:34.608463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc1ca-0bd1-46b5-9610-6b81ee417228 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:34.609530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc1ca-0bd1-46b5-9610-6b81ee417228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:34.662205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-080cc1ca-0bd1-46b5-9610-6b81ee417228 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:34.664618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-080cc1ca-0bd1-46b5-9610-6b81ee417228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:34.730542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:34.731437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:34.735598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:34.736873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:34.743540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:34.823088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 841/1675] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:34.830881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dc9f4-ede6-4a38-8f62-f61bf6f39c17 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:34.831304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dc9f4-ede6-4a38-8f62-f61bf6f39c17 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:34.831683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dc9f4-ede6-4a38-8f62-f61bf6f39c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:34.888955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-585dc9f4-ede6-4a38-8f62-f61bf6f39c17 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:34.890312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-585dc9f4-ede6-4a38-8f62-f61bf6f39c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:34.923620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 842/1676] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:34.929860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:34.933286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:34.933442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dc9f4-ede6-4a38-8f62-f61bf6f39c17 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:34.984095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 835/1677] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:09:34.995283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dc9f4-ede6-4a38-8f62-f61bf6f39c17 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:35.027399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50e70-34d7-4c47-8c86-c1f472399d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:35.028014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e70-34d7-4c47-8c86-c1f472399d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:35.028238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e70-34d7-4c47-8c86-c1f472399d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:35.035814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e70-34d7-4c47-8c86-c1f472399d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:35.035814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50e70-34d7-4c47-8c86-c1f472399d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:35.035814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50e70-34d7-4c47-8c86-c1f472399d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:35.043293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50e70-34d7-4c47-8c86-c1f472399d37 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:35.068231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 843/1678] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:35.074567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:35.086720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d5c05-dde7-425b-b9d8-ced2c33dd64f service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:35.093988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:35.095018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:35.096038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:35.096570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:35.098170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:35.108004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:35.219551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:35.219798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:35.221364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:35.241719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 836/1679] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:35 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:35.246691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:35.254728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:35.313259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] MFA Rules not processed for user `47da043ec00e4b1d873267c39d0abcea`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:35.314699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:35.404041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b59e0a-a508-48f1-ae2b-107cb67eaeeb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:35.420836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:35.421473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:35.421772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:35.422726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:35.424968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:35.428295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:35.475477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 844/1680] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:09:35.483712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:35.483712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:35.526876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a5ea9-be92-45a9-bb73-05294174a9c3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:35.540005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:35.542040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:35.542435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:35.544775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] PATH_INFO: `/v3/projects/f55ec8ad9e104378a7faa5c1994928d9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:35.551045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55ec8ad9e104378a7faa5c1994928d9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:35.557502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:35.589443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 837/1681] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:35 2022] POST /identity/v3/users => generated 286 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:35.592809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:35.601081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:35.816555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55ec8ad9e104378a7faa5c1994928d9', 'request_id': 'req-4e26ec60-450c-47b1-a29e-af013faa05a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:35.831318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55ec8ad9e104378a7faa5c1994928d9', 'request_id': 'req-4e26ec60-450c-47b1-a29e-af013faa05a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:35.846308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55ec8ad9e104378a7faa5c1994928d9', 'request_id': 'req-4e26ec60-450c-47b1-a29e-af013faa05a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:35.856838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28975d43-62c8-40b4-80ca-647300ee2ebb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:35.955530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] The token cache is being invalidate because project f55ec8ad9e104378a7faa5c1994928d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:35.956792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:35.958927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:35.966681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 845/1682] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:35 2022] DELETE /identity/v3/projects/f55ec8ad9e104378a7faa5c1994928d9 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:35.966681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:35.971047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:35.974874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:35.981988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:35.982489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:35.982964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:35.986180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.116203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ec60-450c-47b1-a29e-af013faa05a3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:36.122212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:36.122973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.123818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.123818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] PATH_INFO: `/v3/projects/c2fc5d23412e43218c90be403c66b2b7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.124792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2fc5d23412e43218c90be403c66b2b7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:36.127015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:36.139836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:36.142719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:36.197821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 838/1683] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:36.199888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:36.203107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.235927 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f91db-c90f-4484-ac2c-80a9624d27f6 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:36.250631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:36.250631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.250631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.250631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.253434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:36.256963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:36.288568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 839/1684] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:36.295128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:36.302608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.382182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fc5d23412e43218c90be403c66b2b7', 'request_id': 'req-345a9400-e7d5-4c1f-a0df-11bb007c60ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:36.406433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fc5d23412e43218c90be403c66b2b7', 'request_id': 'req-345a9400-e7d5-4c1f-a0df-11bb007c60ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:36.429630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fc5d23412e43218c90be403c66b2b7', 'request_id': 'req-345a9400-e7d5-4c1f-a0df-11bb007c60ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:36.542645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] The token cache is being invalidate because project c2fc5d23412e43218c90be403c66b2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:36.543353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:36.544407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-345a9400-e7d5-4c1f-a0df-11bb007c60ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:36.546348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 846/1685] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:35 2022] DELETE /identity/v3/projects/c2fc5d23412e43218c90be403c66b2b7 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:36.547813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.549420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.550486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.579091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0aafe-66e8-4e75-9980-6d553dc13c4a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:36.602536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:36.607095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.692893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dc0f7-f19d-4db8-91ce-abc2b9050623 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:36.693532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc0f7-f19d-4db8-91ce-abc2b9050623 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.696986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc0f7-f19d-4db8-91ce-abc2b9050623 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.697325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dc0f7-f19d-4db8-91ce-abc2b9050623 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.703825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-539dc0f7-f19d-4db8-91ce-abc2b9050623 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.732647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dc0f7-f19d-4db8-91ce-abc2b9050623 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:36.739462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dc0f7-f19d-4db8-91ce-abc2b9050623 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:36.790934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 847/1686] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:36.791118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 840/1687] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:36.791259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:36.791381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893f7d0-74e6-494b-9635-11027abf0f86 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.791381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893f7d0-74e6-494b-9635-11027abf0f86 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.791381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893f7d0-74e6-494b-9635-11027abf0f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.792870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.844055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e9f81-dad8-4d81-bdff-7504d3e9f9d1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:36.847267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c893f7d0-74e6-494b-9635-11027abf0f86 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:36.849458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c893f7d0-74e6-494b-9635-11027abf0f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.864167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee93c-2c45-4e3f-b343-4f937a31edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:36.865875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee93c-2c45-4e3f-b343-4f937a31edf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.866753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee93c-2c45-4e3f-b343-4f937a31edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.868201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee93c-2c45-4e3f-b343-4f937a31edf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.872295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee93c-2c45-4e3f-b343-4f937a31edf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:36.880213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 841/1688] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:36.880213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88115414-e280-48b4-b5c1-a240c087da11 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.880213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88115414-e280-48b4-b5c1-a240c087da11 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.880213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88115414-e280-48b4-b5c1-a240c087da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.880651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee93c-2c45-4e3f-b343-4f937a31edf3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:36.917817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-88115414-e280-48b4-b5c1-a240c087da11 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:36.919057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-88115414-e280-48b4-b5c1-a240c087da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:36.927000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 848/1689] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:36.930536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7441353-3c73-4574-b2e0-8a9b89f513b0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.931560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7441353-3c73-4574-b2e0-8a9b89f513b0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.932514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7441353-3c73-4574-b2e0-8a9b89f513b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:36.943587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=92 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:36.954204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 842/1690] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:36.955713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88115414-e280-48b4-b5c1-a240c087da11 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:36.980261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88115414-e280-48b4-b5c1-a240c087da11 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:36.989963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:36.993653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:36.996182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:36.996495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] PATH_INFO: `/v3/projects/629d915856e94bfeac628239d74661d3/users/dc8ef878062d4be998dc543b7548a111/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:37.022733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d7441353-3c73-4574-b2e0-8a9b89f513b0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:37.026716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d7441353-3c73-4574-b2e0-8a9b89f513b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:37.031411 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629d915856e94bfeac628239d74661d3, user_id=dc8ef878062d4be998dc543b7548a111, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:37.037792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:37.046188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 849/1691] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:37.050664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7441353-3c73-4574-b2e0-8a9b89f513b0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:37.069016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7441353-3c73-4574-b2e0-8a9b89f513b0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:37.077243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:37.078726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:37.079132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:37.079678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:37.081193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:37.081552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:37.083516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:37.118666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 850/1692] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:37.119921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:37.142374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 843/1693] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:36 2022] PUT /identity/v3/projects/629d915856e94bfeac628239d74661d3/users/dc8ef878062d4be998dc543b7548a111/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:37.143067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:37.167720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ebe18-686c-4c55-9608-55c85dc5fe29 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:37.208115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:37.286008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf6d61-404b-4ae8-81e5-fd463f426760 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:37.293735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:37.296765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:37.296765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:37.296765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:37.296765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:37.297522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:37.357076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a719d0-6d25-4aeb-940c-f13db256d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:37.365880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a719d0-6d25-4aeb-940c-f13db256d2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:37.365880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a719d0-6d25-4aeb-940c-f13db256d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:37.365880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a719d0-6d25-4aeb-940c-f13db256d2ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:37.365880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a719d0-6d25-4aeb-940c-f13db256d2ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:37.365880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a719d0-6d25-4aeb-940c-f13db256d2ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:37.365880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a719d0-6d25-4aeb-940c-f13db256d2ae admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:37.410147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 851/1694] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:37.411496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864448bb-36dc-4f1c-bc66-7d9b0ed6adea None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:37.412175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864448bb-36dc-4f1c-bc66-7d9b0ed6adea None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:37.412462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864448bb-36dc-4f1c-bc66-7d9b0ed6adea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:37.424545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 844/1695] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:37 2022] POST /identity/v3/projects => generated 389 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:37.428544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:37.534468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-864448bb-36dc-4f1c-bc66-7d9b0ed6adea None None] MFA Rules not processed for user `dc8ef878062d4be998dc543b7548a111`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:37.537442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-864448bb-36dc-4f1c-bc66-7d9b0ed6adea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:37.642270 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396252e-1dd7-4fbd-9f8b-8ce1554bfcf1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:37.656923 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:37.661510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:37.662351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:37.662351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:37.663040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:37.675178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:37.675379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 852/1696] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:37.675379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864448bb-36dc-4f1c-bc66-7d9b0ed6adea None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:37.692098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864448bb-36dc-4f1c-bc66-7d9b0ed6adea None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:37.701270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:37.701952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:37.702251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:37.702502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:37.703140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:37.705130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:37.829617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 853/1697] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:37 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:37.830917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:37.832722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:37.857011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 845/1698] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:37 2022] POST /identity/v3/projects => generated 375 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:37.857817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:37.989483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d5d9-be1c-4945-ac2b-4373367d9621 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.004093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.004750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.005038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.006589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.007269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.011853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.038321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 846/1699] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:38.039275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:38.043040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf24035-b98a-48b3-9ff7-f71ab962f744 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.090624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0471f-7f4d-479f-940c-ccc2c4e1c2d5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.113476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.126677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.132424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.132598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.133906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.137889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.173750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.174425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.174714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.174992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.312979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 847/1700] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:38 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:38.317963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:38.337618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdd315-876e-48ca-8fb0-bb3afc2e97b0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.350561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.351291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.351477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.351862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.355412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.362987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.363099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.368291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.402270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 854/1701] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:38.403211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:38.437669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 848/1702] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:38.448146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:38.460734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250cc58-cbf9-4d40-88b9-28c99c296b0f service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.481569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.482349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.482637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.486366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.487167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.488824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.513482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c177de-8ade-4800-8516-9f3ee9f9ae0c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.547033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54503-36f5-4ed4-b658-940c5ffd8bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.547033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54503-36f5-4ed4-b658-940c5ffd8bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.547033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54503-36f5-4ed4-b658-940c5ffd8bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.553703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 855/1703] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:38.557882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:38.558167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54503-36f5-4ed4-b658-940c5ffd8bfb admin admin] PATH_INFO: `/v3/projects/07122037132a4a8085d35415a4916500/users/273acd6f3b7b4aba82b53b9496dd1ea2/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.598164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c287bba-0e27-412a-abaa-6399e1f84d50 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.604982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54503-36f5-4ed4-b658-940c5ffd8bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=07122037132a4a8085d35415a4916500, user_id=273acd6f3b7b4aba82b53b9496dd1ea2, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.612679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.613602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.614108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.614485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.615241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.616383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed54503-36f5-4ed4-b658-940c5ffd8bfb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.618373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.649036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 856/1704] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:38.653103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:38.683588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d012cbd-8f5c-4606-9cbd-5a4691a34fad admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:38.725856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198a5d-15dd-487c-bd39-0e90925fd53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:38.730172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198a5d-15dd-487c-bd39-0e90925fd53d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.730466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198a5d-15dd-487c-bd39-0e90925fd53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.730752 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198a5d-15dd-487c-bd39-0e90925fd53d admin admin] PATH_INFO: `/v3/projects/b548cc31d388492ca69f40d3d4d44c9f/users/5f171be0d74c43e5818bdf65f05d0d68/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.745064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 849/1705] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:38 2022] PUT /identity/v3/projects/07122037132a4a8085d35415a4916500/users/273acd6f3b7b4aba82b53b9496dd1ea2/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:38.749743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838fa81-9eba-46e2-b94e-e92f50aff7c9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.751012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838fa81-9eba-46e2-b94e-e92f50aff7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.751431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838fa81-9eba-46e2-b94e-e92f50aff7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:38.820395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198a5d-15dd-487c-bd39-0e90925fd53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b548cc31d388492ca69f40d3d4d44c9f, user_id=5f171be0d74c43e5818bdf65f05d0d68, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:38.828714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198a5d-15dd-487c-bd39-0e90925fd53d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:38.878858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0838fa81-9eba-46e2-b94e-e92f50aff7c9 None None] MFA Rules not processed for user `273acd6f3b7b4aba82b53b9496dd1ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:38.884234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0838fa81-9eba-46e2-b94e-e92f50aff7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:38.916202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 857/1706] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:38 2022] PUT /identity/v3/projects/b548cc31d388492ca69f40d3d4d44c9f/users/5f171be0d74c43e5818bdf65f05d0d68/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:38.933251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda7f3-9579-41b6-a19f-abfcb18b08e6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:38.933809 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda7f3-9579-41b6-a19f-abfcb18b08e6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:38.936378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda7f3-9579-41b6-a19f-abfcb18b08e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:39.031641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a5bda7f3-9579-41b6-a19f-abfcb18b08e6 None None] MFA Rules not processed for user `5f171be0d74c43e5818bdf65f05d0d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:39.033151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a5bda7f3-9579-41b6-a19f-abfcb18b08e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:39.049636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:39.211211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 850/1707] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:39.212200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838fa81-9eba-46e2-b94e-e92f50aff7c9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:39.273509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 858/1708] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:09:39.277891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda7f3-9579-41b6-a19f-abfcb18b08e6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:39.443854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838fa81-9eba-46e2-b94e-e92f50aff7c9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:39.482495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda7f3-9579-41b6-a19f-abfcb18b08e6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:39.494846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:39.495547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:39.495933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:39.496387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:39.497144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:39.500243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:39.593948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:39.593948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:39.593948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:39.593948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:39.594290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:39.594290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:39.701659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 859/1709] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:39 2022] POST /identity/v3/projects => generated 375 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:39.705981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:39.730848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 851/1710] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:39 2022] POST /identity/v3/projects => generated 389 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:39.735443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:39.968247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a9e0-3171-41a0-9913-5d4b90550305 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.022731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:40.036859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb132bac-4e1a-4496-b697-c1fb4e2481e3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.076782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f21c0f-c387-472d-9476-da27eb88e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:40.083159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21c0f-c387-472d-9476-da27eb88e50e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.083159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21c0f-c387-472d-9476-da27eb88e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.083159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f21c0f-c387-472d-9476-da27eb88e50e admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.083159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f21c0f-c387-472d-9476-da27eb88e50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:40.092702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f21c0f-c387-472d-9476-da27eb88e50e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:40.235502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:40.240798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.240798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.240798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.240798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:40.254681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 852/1711] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:39 2022] POST /identity/v3/users => generated 301 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:40.254681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891208ae-4ecf-4567-8877-bea8fabce548 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.254681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891208ae-4ecf-4567-8877-bea8fabce548 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.254681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891208ae-4ecf-4567-8877-bea8fabce548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.256033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:40.329022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-891208ae-4ecf-4567-8877-bea8fabce548 None None] MFA Rules not processed for user `81b68eda0eb445309b4c76ef2aeae190`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:40.331106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-891208ae-4ecf-4567-8877-bea8fabce548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:40.451458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 860/1712] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:39 2022] POST /identity/v3/users => generated 294 bytes in 746 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:40.452498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:40.475612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 853/1713] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:40.476747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cac0fd-5d15-433f-a12f-3135c674f461 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.480556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891208ae-4ecf-4567-8877-bea8fabce548 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:40.490562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f0400-5230-4625-82d1-7e90f4f5ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:40.491496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f0400-5230-4625-82d1-7e90f4f5ced2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.491994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f0400-5230-4625-82d1-7e90f4f5ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.492483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f0400-5230-4625-82d1-7e90f4f5ced2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.498963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f0400-5230-4625-82d1-7e90f4f5ced2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:40.506245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f0400-5230-4625-82d1-7e90f4f5ced2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:40.526386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891208ae-4ecf-4567-8877-bea8fabce548 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.532741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 861/1714] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:40.534589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9ac1-c63b-4f2c-8f18-06e1833e7d04 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.536626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9ac1-c63b-4f2c-8f18-06e1833e7d04 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.537142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf9ac1-c63b-4f2c-8f18-06e1833e7d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.542399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:40.547192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.547192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.547192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.547192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:40.547192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:40.566968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 854/1715] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:40.569888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:40.586648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-76bf9ac1-c63b-4f2c-8f18-06e1833e7d04 None None] MFA Rules not processed for user `81b68eda0eb445309b4c76ef2aeae190`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:40.588325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-76bf9ac1-c63b-4f2c-8f18-06e1833e7d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:40.616749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 862/1716] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:40.618520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9ac1-c63b-4f2c-8f18-06e1833e7d04 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:40.647318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf9ac1-c63b-4f2c-8f18-06e1833e7d04 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.652926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936328fe-0baf-4cd3-bc39-8704240a820e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.662731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:40.665075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.665590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.669888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] PATH_INFO: `/v3/projects/623dec3ca991411489765895ccb47cd4/users/8b36a7c477c543d2a9524b09d8020e1f/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.684157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:40.685001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.688025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.688452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] PATH_INFO: `/v3/projects/d00944820fc14f81981d9b34443d765d/users/b88bafada59748dfab721277ebeff452/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.714795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623dec3ca991411489765895ccb47cd4, user_id=8b36a7c477c543d2a9524b09d8020e1f, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:40.724899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:40.748999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00944820fc14f81981d9b34443d765d, user_id=b88bafada59748dfab721277ebeff452, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:40.751970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:40.799572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 863/1717] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:40 2022] PUT /identity/v3/projects/623dec3ca991411489765895ccb47cd4/users/8b36a7c477c543d2a9524b09d8020e1f/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:40.800411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:40.851768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 855/1718] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:40 2022] PUT /identity/v3/projects/d00944820fc14f81981d9b34443d765d/users/b88bafada59748dfab721277ebeff452/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:40.852850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:40.897380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8565-f9d0-4637-9bd7-7a08d55d69d2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.961945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3b52b-e8c9-4212-b50c-3fcce720fc78 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:40.968217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:40.969163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:40.969727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:40.970306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:40.971162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:40.973199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:40.986206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 856/1719] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:40.987747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:40.999347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801571ce-7bfb-4f10-957a-5c18d0d3cbec admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:41.004875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:41.006454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.007118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.007617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.008592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:41.010637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:41.023961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 857/1720] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:41.026652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:41.039364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f87dda-7acc-41e0-8dd6-0c7fc756ba95 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:41.046010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:41.047465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.047948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.048439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] PATH_INFO: `/v3/projects/623dec3ca991411489765895ccb47cd4/users/8b36a7c477c543d2a9524b09d8020e1f/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.050872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623dec3ca991411489765895ccb47cd4, user_id=8b36a7c477c543d2a9524b09d8020e1f, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:41.052533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91669b1-f37d-43d6-bac2-a720a619bc92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:41.053253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91669b1-f37d-43d6-bac2-a720a619bc92 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.053532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91669b1-f37d-43d6-bac2-a720a619bc92 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.053822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91669b1-f37d-43d6-bac2-a720a619bc92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.054974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:41.074494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 858/1721] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:41 2022] PUT /identity/v3/projects/623dec3ca991411489765895ccb47cd4/users/8b36a7c477c543d2a9524b09d8020e1f/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:41.078828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:41.095728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:41.201843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91669b1-f37d-43d6-bac2-a720a619bc92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:41.204861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91669b1-f37d-43d6-bac2-a720a619bc92 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:41.220221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 864/1722] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:41.221604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.221973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.222385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.272194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a8f20-3604-414c-aa95-b2be8200e0b2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:41.273016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] MFA Rules not processed for user `8b36a7c477c543d2a9524b09d8020e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:41.292875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:41.293455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f003453-6c8d-4170-863b-098fd759b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:41.293455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f003453-6c8d-4170-863b-098fd759b48f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.293455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f003453-6c8d-4170-863b-098fd759b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.293455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f003453-6c8d-4170-863b-098fd759b48f admin admin] PATH_INFO: `/v3/projects/d00944820fc14f81981d9b34443d765d/users/b88bafada59748dfab721277ebeff452/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.303261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f003453-6c8d-4170-863b-098fd759b48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00944820fc14f81981d9b34443d765d, user_id=b88bafada59748dfab721277ebeff452, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:41.310718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f003453-6c8d-4170-863b-098fd759b48f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:41.358455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 859/1723] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:41 2022] PUT /identity/v3/projects/d00944820fc14f81981d9b34443d765d/users/b88bafada59748dfab721277ebeff452/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:41.363791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.364679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.365174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.427894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] MFA Rules not processed for user `b88bafada59748dfab721277ebeff452`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:41.429321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:41.502214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 865/1724] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:41.515708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:41.521122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:41.650977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6718bd-c149-4ce6-aa3b-28e57e625c8c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:41.653080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 860/1725] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:41.739506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50160d06-c3df-4386-af5f-87268b97a3fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:41.740719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50160d06-c3df-4386-af5f-87268b97a3fb service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.741309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50160d06-c3df-4386-af5f-87268b97a3fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.741654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50160d06-c3df-4386-af5f-87268b97a3fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.755200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:41.757084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:41.783217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc98efe-902e-46be-afb6-6ba026f63f75 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:41.797919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ccb1b-b459-4ec7-bc65-2f7590fd9b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:41.798638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ccb1b-b459-4ec7-bc65-2f7590fd9b1e service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.799001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ccb1b-b459-4ec7-bc65-2f7590fd9b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.799330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ccb1b-b459-4ec7-bc65-2f7590fd9b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:41.820759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ccb1b-b459-4ec7-bc65-2f7590fd9b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:41.823376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ccb1b-b459-4ec7-bc65-2f7590fd9b1e service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:41.854436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 861/1726] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:41.919389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50160d06-c3df-4386-af5f-87268b97a3fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:41.928445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50160d06-c3df-4386-af5f-87268b97a3fb service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:41.968551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 866/1727] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:41.994042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956143-4401-41db-af5c-193e002d47fe None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:41.994409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956143-4401-41db-af5c-193e002d47fe None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:41.994822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e956143-4401-41db-af5c-193e002d47fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:42.035890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2e956143-4401-41db-af5c-193e002d47fe None None] MFA Rules not processed for user `a7356e1101a14bc7a7a9d0565461c318`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:42.042188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2e956143-4401-41db-af5c-193e002d47fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:42.212055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 862/1728] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:42.240011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd0be4-18fa-4d80-b6b7-7312ed274cd6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:42.240405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd0be4-18fa-4d80-b6b7-7312ed274cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:42.241173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd0be4-18fa-4d80-b6b7-7312ed274cd6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:42.242914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 867/1729] 10.222.0.26 () {54 vars in 912 bytes} [Mon Oct 3 16:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:42.251431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710512f-7473-46e3-b9bf-749b0b162976 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:42.251720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710512f-7473-46e3-b9bf-749b0b162976 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:42.252018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710512f-7473-46e3-b9bf-749b0b162976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:42.328341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4710512f-7473-46e3-b9bf-749b0b162976 None None] MFA Rules not processed for user `bf531e7741af49f091e1116ec1c6751c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:42.328341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4710512f-7473-46e3-b9bf-749b0b162976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:42.475880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd0be4-18fa-4d80-b6b7-7312ed274cd6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:42.482725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-57fd0be4-18fa-4d80-b6b7-7312ed274cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:42.488683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 863/1730] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:42.488683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290412-6a19-40c2-a0b3-258966f2e063 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:42.488683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290412-6a19-40c2-a0b3-258966f2e063 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:42.488683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23290412-6a19-40c2-a0b3-258966f2e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:42.508740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd0be4-18fa-4d80-b6b7-7312ed274cd6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:42.513715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:42.514377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:42.514688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:42.514963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:42.524207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:42.526442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:42.544620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 868/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:09:42.639626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:42.670782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:42.710493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-23290412-6a19-40c2-a0b3-258966f2e063 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:42.715148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-23290412-6a19-40c2-a0b3-258966f2e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:42.816919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:42.856215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afba012-ad8f-417f-ac6d-89ebe18d676c service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:42.873340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 864/1732] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:42.880604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:42.881611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:42.884151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:42.884236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:42.884236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:42.884236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:42.884446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] PATH_INFO: `/v3/users/273acd6f3b7b4aba82b53b9496dd1ea2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:42.888209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=273acd6f3b7b4aba82b53b9496dd1ea2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:42.893953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:42.933713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] MFA Rules not processed for user `47da043ec00e4b1d873267c39d0abcea`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:42.939073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:43.193792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 865/1733] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:43.347875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '273acd6f3b7b4aba82b53b9496dd1ea2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:43.433409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:43.435247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:43.455802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '273acd6f3b7b4aba82b53b9496dd1ea2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:43.470067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '273acd6f3b7b4aba82b53b9496dd1ea2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:43.472462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '273acd6f3b7b4aba82b53b9496dd1ea2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:43.538495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '273acd6f3b7b4aba82b53b9496dd1ea2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:43.561212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 869/1734] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:42 2022] DELETE /identity/v3/users/273acd6f3b7b4aba82b53b9496dd1ea2 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:43.566007 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:43.581004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:43.687027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f2ba7-2dfa-4b87-983c-79a75a49caeb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:43.851715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fabb8-85b9-4d58-9754-229dd5adeb54 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:43.860937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28cbee-1a36-41da-9c50-bb8935207817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:43.861568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28cbee-1a36-41da-9c50-bb8935207817 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:43.861926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28cbee-1a36-41da-9c50-bb8935207817 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:43.862196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28cbee-1a36-41da-9c50-bb8935207817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:43.866903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2e28cbee-1a36-41da-9c50-bb8935207817 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:43.870192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:43.871918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:43.872370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:43.872801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] PATH_INFO: `/v3/users/dc8ef878062d4be998dc543b7548a111` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:43.876532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8ef878062d4be998dc543b7548a111)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:43.878886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:44.022679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28cbee-1a36-41da-9c50-bb8935207817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:44.024279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28cbee-1a36-41da-9c50-bb8935207817 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:44.064073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 866/1735] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:09:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:09:44.065440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:44.065738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:44.066680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:44.114882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:44.125896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:44.160983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 867/1736] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:44.160983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:44.162480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:44.234218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8ef878062d4be998dc543b7548a111'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:44.299217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932ea57-6b2c-408a-b90a-6a2756ae8888 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:44.303807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595170c-c1cb-4fbf-a632-9c75c9dc7c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:44.304690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595170c-c1cb-4fbf-a632-9c75c9dc7c03 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:44.305025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595170c-c1cb-4fbf-a632-9c75c9dc7c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:44.305400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595170c-c1cb-4fbf-a632-9c75c9dc7c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:44.326124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595170c-c1cb-4fbf-a632-9c75c9dc7c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:44.328851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595170c-c1cb-4fbf-a632-9c75c9dc7c03 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:44.354051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8ef878062d4be998dc543b7548a111'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:44.369984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8ef878062d4be998dc543b7548a111'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:44.369984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8ef878062d4be998dc543b7548a111'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:44.370159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 868/1737] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:09:44.444341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:44.447468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8ef878062d4be998dc543b7548a111'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:44.478955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 870/1738] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:43 2022] DELETE /identity/v3/users/dc8ef878062d4be998dc543b7548a111 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:44.482261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e65a-9160-4ebc-a815-66773879cc85 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:44.482700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e65a-9160-4ebc-a815-66773879cc85 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:44.483061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29e65a-9160-4ebc-a815-66773879cc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:44.539271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:44.546647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ee29e65a-9160-4ebc-a815-66773879cc85 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:44.549261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ee29e65a-9160-4ebc-a815-66773879cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:44.840668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 869/1739] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:44.914595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:44.914595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:44.938596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443221d-e516-4388-a90a-419e50ece837 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:44.939898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443221d-e516-4388-a90a-419e50ece837 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:44.940390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443221d-e516-4388-a90a-419e50ece837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:45.016179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1443221d-e516-4388-a90a-419e50ece837 None None] MFA Rules not processed for user `81b68eda0eb445309b4c76ef2aeae190`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:45.037524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1443221d-e516-4388-a90a-419e50ece837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:45.162994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16559543-41a6-4b1d-a89e-266c8abd1b08 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:45.182822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30475-0427-49d9-ad62-d6e95526fac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:45.183599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30475-0427-49d9-ad62-d6e95526fac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:45.183936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30475-0427-49d9-ad62-d6e95526fac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:45.204965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30475-0427-49d9-ad62-d6e95526fac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:45.238816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30475-0427-49d9-ad62-d6e95526fac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:45.241232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30475-0427-49d9-ad62-d6e95526fac9 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:45.260042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 871/1740] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:45.356045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:45.356326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:45.356775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:45.418825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] MFA Rules not processed for user `bf531e7741af49f091e1116ec1c6751c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:45.420377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:45.443071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 872/1741] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Oct 3 16:09:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:45.457071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 870/1742] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:45.483945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:45.485809 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:45.509142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183cbc4-c442-45e6-aa11-afa04eabeacd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:45.516199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:45.519379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:45.520076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:45.520395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:45.541535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:45.543379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:45.561206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 873/1743] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:45.960046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:46.110464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:46.467734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443221d-e516-4388-a90a-419e50ece837 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:46.474046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1443221d-e516-4388-a90a-419e50ece837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:46.617987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:46.619653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:46.655225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca644b3b-b6ad-4f91-bf22-04984cfe3cab service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:46.664193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443221d-e516-4388-a90a-419e50ece837 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:46.668528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:46.669658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:46.670273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:46.671066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] PATH_INFO: `/v3/projects/07122037132a4a8085d35415a4916500` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:46.673779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07122037132a4a8085d35415a4916500)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:46.674532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:46.676842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:46.677236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:46.678273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:46.679827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:46.684644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:46.930425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:46.932085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:46.999432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 871/1744] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:47.002404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:47.007677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:47.013691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07122037132a4a8085d35415a4916500', 'request_id': 'req-8826dad5-9358-498e-b176-60508afce141'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.035628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07122037132a4a8085d35415a4916500', 'request_id': 'req-8826dad5-9358-498e-b176-60508afce141'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.060918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0ce05-ee32-467e-af06-1c2d11de1d98 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:47.067106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07122037132a4a8085d35415a4916500', 'request_id': 'req-8826dad5-9358-498e-b176-60508afce141'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.266565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:47.267414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:47.267688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:47.267967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] PATH_INFO: `/v3/projects/629d915856e94bfeac628239d74661d3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:47.271938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629d915856e94bfeac628239d74661d3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:47.274222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:47.293328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] The token cache is being invalidate because project 07122037132a4a8085d35415a4916500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:47.295592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.297222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.299267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 874/1745] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:46 2022] DELETE /identity/v3/projects/07122037132a4a8085d35415a4916500 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:47.305614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:47.310187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:47.352026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826dad5-9358-498e-b176-60508afce141 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:47.362650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:47.364414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:47.364414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:47.364414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] PATH_INFO: `/v3/users/b88bafada59748dfab721277ebeff452` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:47.366055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88bafada59748dfab721277ebeff452)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:47.383312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:47.479329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629d915856e94bfeac628239d74661d3', 'request_id': 'req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.490800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629d915856e94bfeac628239d74661d3', 'request_id': 'req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.506433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629d915856e94bfeac628239d74661d3', 'request_id': 'req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.626978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] The token cache is being invalidate because project 629d915856e94bfeac628239d74661d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:47.627639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.628841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9c823ad7-2e64-4e69-aeb9-e59bc4ffec83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.631036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 872/1746] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:46 2022] DELETE /identity/v3/projects/629d915856e94bfeac628239d74661d3 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:47.637006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4f72-79be-45dc-8b12-123d7e743eb1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:47.637500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4f72-79be-45dc-8b12-123d7e743eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:47.638068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4f72-79be-45dc-8b12-123d7e743eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:47.663383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88bafada59748dfab721277ebeff452'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.717236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4d6a4f72-79be-45dc-8b12-123d7e743eb1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:47.718659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4d6a4f72-79be-45dc-8b12-123d7e743eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:47.748638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88bafada59748dfab721277ebeff452'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.758942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88bafada59748dfab721277ebeff452'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.761047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88bafada59748dfab721277ebeff452'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.782334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-14cf22cb-4662-447b-817c-509feb79a5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88bafada59748dfab721277ebeff452'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:47.798885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 875/1747] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:47 2022] DELETE /identity/v3/users/b88bafada59748dfab721277ebeff452 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:47.804638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:47.884141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:47.960503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 873/1748] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:09:47.969321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dfb2d-2674-43bb-a4d0-2424437704fa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:47.969897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dfb2d-2674-43bb-a4d0-2424437704fa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:47.970327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dfb2d-2674-43bb-a4d0-2424437704fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:47.994626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-102dfb2d-2674-43bb-a4d0-2424437704fa None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:48.004772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-102dfb2d-2674-43bb-a4d0-2424437704fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:48.186691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 876/1749] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:48.191058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a4f72-79be-45dc-8b12-123d7e743eb1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:48.212993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a4f72-79be-45dc-8b12-123d7e743eb1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:48.227866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:48.229209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:48.229499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:48.229785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:48.230470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:48.230804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:48.232589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:48.264660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 874/1750] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:48.264948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dfb2d-2674-43bb-a4d0-2424437704fa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:48.279986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dfb2d-2674-43bb-a4d0-2424437704fa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:48.293998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7114a-4d75-47d0-a452-ba15c6aa58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:48.294630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7114a-4d75-47d0-a452-ba15c6aa58a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:48.295076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7114a-4d75-47d0-a452-ba15c6aa58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:48.295194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7114a-4d75-47d0-a452-ba15c6aa58a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:48.296023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7114a-4d75-47d0-a452-ba15c6aa58a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:48.298044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7114a-4d75-47d0-a452-ba15c6aa58a8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:48.763420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 877/1751] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:48 2022] POST /identity/v3/projects => generated 367 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:48.763541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:48.771479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd1f64-c082-4f28-9ef3-92a2647e8922 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:48.992062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:48.992981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:48.993481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:48.994028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:48.995098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:48.997570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:49.048491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9573-883c-452c-bfbb-306ef8f7aa45 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:49.052473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9573-883c-452c-bfbb-306ef8f7aa45 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:49.053032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9573-883c-452c-bfbb-306ef8f7aa45 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:49.061580 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 878/1752] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:09:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:49.138153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 875/1753] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:48 2022] POST /identity/v3/users => generated 284 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:49.144242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9573-883c-452c-bfbb-306ef8f7aa45 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:49.193090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9573-883c-452c-bfbb-306ef8f7aa45 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:49.227690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cd9f1-0d1d-40fc-a4c7-1c804820ae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:49.235747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd9f1-0d1d-40fc-a4c7-1c804820ae36 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:49.241628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd9f1-0d1d-40fc-a4c7-1c804820ae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:49.241628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cd9f1-0d1d-40fc-a4c7-1c804820ae36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:49.241628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cd9f1-0d1d-40fc-a4c7-1c804820ae36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:49.256250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cd9f1-0d1d-40fc-a4c7-1c804820ae36 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:49.325498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 879/1754] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:49.330879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:49.344550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29695f82-2f73-4ee8-9641-3fa076668bc0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:49.387363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:49.388088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:49.388562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:49.388934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:49.390007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:49.392089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:49.392770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24df8-e385-4562-a2c0-b38c707575b2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:49.393062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24df8-e385-4562-a2c0-b38c707575b2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:49.393380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb24df8-e385-4562-a2c0-b38c707575b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:49.417721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 876/1755] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:49.417721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:49.427740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f89c8-0513-4fe4-83f3-3ce483e6c9a8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:49.433945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:49.435083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:49.435417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:49.435700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] PATH_INFO: `/v3/projects/fe85157156e340539b6292ed9fe8ca64/users/e319f5e07a0e44c78ebcc8a2d6f64688/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:49.538459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ccb24df8-e385-4562-a2c0-b38c707575b2 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:49.544381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ccb24df8-e385-4562-a2c0-b38c707575b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:49.557089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe85157156e340539b6292ed9fe8ca64, user_id=e319f5e07a0e44c78ebcc8a2d6f64688, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:49.560149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:49.706218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 877/1756] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:49 2022] PUT /identity/v3/projects/fe85157156e340539b6292ed9fe8ca64/users/e319f5e07a0e44c78ebcc8a2d6f64688/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:49.707095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:49.737445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:49.809277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 880/1757] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 03 16:09:49.809277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:49.812522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:49.813016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:49.860475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] MFA Rules not processed for user `e319f5e07a0e44c78ebcc8a2d6f64688`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:49.865098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:49.913038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03f7be-48c4-4cd7-a38a-37b28d92bce9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:49.921537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:49.922595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:49.923051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:49.923696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] PATH_INFO: `/v3/users/2348471d0ee04cf582952db2681d4b1b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:49.925712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2348471d0ee04cf582952db2681d4b1b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:49.928826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:49.958033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:50.005042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 881/1758] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:50.006101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:50.008405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:50.071098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:50.215724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aaaaf-e778-481b-84c2-c20e02053fce None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:50.242157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:50.245273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:50.245273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:50.245273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:50.285342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2348471d0ee04cf582952db2681d4b1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:50.290180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2348471d0ee04cf582952db2681d4b1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:50.299393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:50.311459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:50.372025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 882/1759] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:50.373035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:50.377425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:50.388838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2348471d0ee04cf582952db2681d4b1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:50.397463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2348471d0ee04cf582952db2681d4b1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:50.471823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-90bdf34c-aef1-4e5d-bda2-088a06fe7085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2348471d0ee04cf582952db2681d4b1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:50.497979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 878/1760] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:49 2022] DELETE /identity/v3/users/2348471d0ee04cf582952db2681d4b1b => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:50.515739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:50.516027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:50.517668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:50.533458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100e86-231a-45b5-9741-a98cc6ec2323 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:50.637121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:50.644851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:50.675791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:50.676457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:50.676829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:50.677239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:50.679654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:50.685305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:50.854402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:50.857455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:50.872341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 883/1761] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:50.873849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:50.883655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:50.885144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:50.936191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 879/1762] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:51.019569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:51.022674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:51.136468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f2c1b-c5a0-4803-9a8b-449862e6c3a5 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:51.160225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:51.164469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:51.166254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:51.167601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] PATH_INFO: `/v3/projects/d00944820fc14f81981d9b34443d765d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:51.173126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00944820fc14f81981d9b34443d765d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:51.180719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:51.234041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d203fa-69a0-4f3b-ab8f-3b24fa845145 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:51.247081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8018540-8257-48e2-863a-98d5aefaf7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:51.248106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8018540-8257-48e2-863a-98d5aefaf7ce service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:51.248355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8018540-8257-48e2-863a-98d5aefaf7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:51.248656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8018540-8257-48e2-863a-98d5aefaf7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:51.263861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8018540-8257-48e2-863a-98d5aefaf7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:51.265573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8018540-8257-48e2-863a-98d5aefaf7ce service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:51.279001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 880/1763] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:51.476659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00944820fc14f81981d9b34443d765d', 'request_id': 'req-2b70d538-8e0c-495b-bbf4-9ec800919246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:51.496460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00944820fc14f81981d9b34443d765d', 'request_id': 'req-2b70d538-8e0c-495b-bbf4-9ec800919246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:51.510349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00944820fc14f81981d9b34443d765d', 'request_id': 'req-2b70d538-8e0c-495b-bbf4-9ec800919246'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:51.584909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] The token cache is being invalidate because project d00944820fc14f81981d9b34443d765d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:51.587893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:51.587893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b70d538-8e0c-495b-bbf4-9ec800919246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:51.587893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 884/1764] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:50 2022] DELETE /identity/v3/projects/d00944820fc14f81981d9b34443d765d => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:51.595463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d28e-7436-4ed9-a5e3-de176fbd0105 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:51.595772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d28e-7436-4ed9-a5e3-de176fbd0105 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:51.596045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d28e-7436-4ed9-a5e3-de176fbd0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:51.626077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e8a1d28e-7436-4ed9-a5e3-de176fbd0105 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:51.636515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e8a1d28e-7436-4ed9-a5e3-de176fbd0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:51.667623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:51.773674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 881/1765] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:51.781045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6a216-1c65-4858-9747-8b8ae6f8472f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:51.781550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6a216-1c65-4858-9747-8b8ae6f8472f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:51.782017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6a216-1c65-4858-9747-8b8ae6f8472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:51.841970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7fa6a216-1c65-4858-9747-8b8ae6f8472f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:51.845797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7fa6a216-1c65-4858-9747-8b8ae6f8472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:51.873502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 885/1766] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:51.882519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1d28e-7436-4ed9-a5e3-de176fbd0105 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:51.902350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1d28e-7436-4ed9-a5e3-de176fbd0105 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:51.917072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:51.917935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:51.918708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:51.919715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:51.921819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:51.923145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:51.926445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:51.954936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 882/1767] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:51.956064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6a216-1c65-4858-9747-8b8ae6f8472f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:51.975638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6a216-1c65-4858-9747-8b8ae6f8472f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:51.999451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:52.002363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:52.002471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:52.002739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:52.014152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:52.016380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:52.220781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 886/1768] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:51 2022] POST /identity/v3/projects => generated 409 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:52.229801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:52.251571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffead03-3bed-4f18-9f34-2705df5383ac admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:52.384994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:52.384994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:52.384994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:52.384994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:52.385279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:52.386559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:52.499098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:52.539309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 883/1769] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:52 2022] POST /identity/v3/users => generated 305 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:52.539885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:52.557410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5672ac-0522-4f6e-883a-f7348e97b61d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:52.576995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:52.577744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:52.578116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:52.578461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:52.579436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:52.590704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:52.617314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 887/1770] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:52.622226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:52.642397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe382859-5f3b-498c-80b1-4a03b8d3dd9d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:52.648977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b71355-0d20-4c98-9546-5c91f0558d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:52.650018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71355-0d20-4c98-9546-5c91f0558d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:52.650701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71355-0d20-4c98-9546-5c91f0558d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:52.651379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b71355-0d20-4c98-9546-5c91f0558d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:52.652410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b71355-0d20-4c98-9546-5c91f0558d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:52.655629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b71355-0d20-4c98-9546-5c91f0558d4e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:52.672753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 884/1771] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:09:52.678684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:52.700437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9665d3-7e6e-4be4-877d-9ce9c2ee5d4c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:52.712701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:52.714996 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:52.715286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:52.715571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] PATH_INFO: `/v3/projects/ce22cc0573d84f69a015a7c5b8040a26/users/5a757a875c914bdcb5a3f873f3993aee/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:52.799817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce22cc0573d84f69a015a7c5b8040a26, user_id=5a757a875c914bdcb5a3f873f3993aee, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:52.805394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:52.964076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 888/1772] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:52 2022] PUT /identity/v3/projects/ce22cc0573d84f69a015a7c5b8040a26/users/5a757a875c914bdcb5a3f873f3993aee/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:52.965999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d0c0-fcef-4619-abf8-4feb14c9587b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:52.967010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d0c0-fcef-4619-abf8-4feb14c9587b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:52.967856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722d0c0-fcef-4619-abf8-4feb14c9587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:53.083507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:53.086653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:53.089426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f722d0c0-fcef-4619-abf8-4feb14c9587b None None] MFA Rules not processed for user `5a757a875c914bdcb5a3f873f3993aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:53.090097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f722d0c0-fcef-4619-abf8-4feb14c9587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:53.104698 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:53.326818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b6945-79eb-4376-b2bd-3da6af39a21b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:53.333819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 885/1773] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:09:53.335941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d0c0-fcef-4619-abf8-4feb14c9587b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:53.344439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:53.344905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:53.345198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:53.345469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] PATH_INFO: `/v3/projects/d30630add77e4cceb7140feb0663ca03` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:53.348031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30630add77e4cceb7140feb0663ca03)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:53.350302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:53.375129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722d0c0-fcef-4619-abf8-4feb14c9587b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:53.405845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:53.406917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:53.407291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:53.407582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:53.408243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:53.412834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:53.554640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30630add77e4cceb7140feb0663ca03', 'request_id': 'req-92c60d35-6fd6-4132-975d-a16d38508fc5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:53.568822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30630add77e4cceb7140feb0663ca03', 'request_id': 'req-92c60d35-6fd6-4132-975d-a16d38508fc5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:53.571801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 886/1774] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:53 2022] POST /identity/v3/projects => generated 405 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:53.576279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:53.586306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30630add77e4cceb7140feb0663ca03', 'request_id': 'req-92c60d35-6fd6-4132-975d-a16d38508fc5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:53.678940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] The token cache is being invalidate because project d30630add77e4cceb7140feb0663ca03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:53.681821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:53.688935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:53.694401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 889/1775] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:53 2022] DELETE /identity/v3/projects/d30630add77e4cceb7140feb0663ca03 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:53.700011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:53.704689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:53.712314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242f6a4-0b3e-4f4a-9dcd-8541f4306082 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:53.727156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:53.729277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:53.729871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:53.730408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:53.731922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:53.736537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:53.876294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 887/1776] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:53 2022] POST /identity/v3/users => generated 309 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:53.880645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:53.883909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:53.956784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c60d35-6fd6-4132-975d-a16d38508fc5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:53.982090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4c575-d98a-48e6-8ebe-6645cf6f95cd admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:53.985069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:53.986108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:53.987760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:53.991748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] PATH_INFO: `/v3/users/f4c67472a7f74f3fb34f796b0b442454` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:54.007456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c67472a7f74f3fb34f796b0b442454)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:54.012277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:54.034356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:54.034356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:54.034356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:54.034356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:54.034356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:54.034801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:54.079937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 888/1777] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:54.082085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:54.123507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d1a0-80bf-4964-af5b-eddb59acf890 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:54.136786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:54.142365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:54.142914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:54.143379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] PATH_INFO: `/v3/projects/da5253b12fb448c3b30180d9bea1d50a/users/71fc009ebb574560b6b712c3aca8b808/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:54.219862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5253b12fb448c3b30180d9bea1d50a, user_id=71fc009ebb574560b6b712c3aca8b808, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:54.238509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:54.336438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 889/1778] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:54 2022] PUT /identity/v3/projects/da5253b12fb448c3b30180d9bea1d50a/users/71fc009ebb574560b6b712c3aca8b808/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:54.342290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:54.358510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:54.389987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c67472a7f74f3fb34f796b0b442454'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:54.472128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c67472a7f74f3fb34f796b0b442454'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:54.482772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c67472a7f74f3fb34f796b0b442454'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:54.484929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c67472a7f74f3fb34f796b0b442454'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:54.520563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c67472a7f74f3fb34f796b0b442454'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:54.537488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35649313-2576-4994-b914-55b8a1cff1b9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:54.538465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 890/1779] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:09:53 2022] DELETE /identity/v3/users/f4c67472a7f74f3fb34f796b0b442454 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:54.678627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:54.826694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb96c3-cf83-4b59-a9ef-df9940dff2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:54.826694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb96c3-cf83-4b59-a9ef-df9940dff2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:54.826694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb96c3-cf83-4b59-a9ef-df9940dff2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:54.826694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb96c3-cf83-4b59-a9ef-df9940dff2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:54.829392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb96c3-cf83-4b59-a9ef-df9940dff2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:54.832628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb96c3-cf83-4b59-a9ef-df9940dff2c7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:54.872794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:54.873512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 890/1780] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:54.879478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:54.971927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedbbee-85a6-4223-b472-f32c2902f203 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:55.001271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:55.002144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:55.002651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:55.005597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] PATH_INFO: `/v3/projects/da5253b12fb448c3b30180d9bea1d50a/users/71fc009ebb574560b6b712c3aca8b808/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:55.016252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5253b12fb448c3b30180d9bea1d50a, user_id=71fc009ebb574560b6b712c3aca8b808, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:55.021082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:55.054249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 891/1781] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:54 2022] PUT /identity/v3/projects/da5253b12fb448c3b30180d9bea1d50a/users/71fc009ebb574560b6b712c3aca8b808/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:55.069349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc2556-fb57-4cde-ae06-28c48b3f388c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:55.070401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc2556-fb57-4cde-ae06-28c48b3f388c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:55.070826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc2556-fb57-4cde-ae06-28c48b3f388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:55.153282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-98cc2556-fb57-4cde-ae06-28c48b3f388c None None] MFA Rules not processed for user `71fc009ebb574560b6b712c3aca8b808`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:55.154868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-98cc2556-fb57-4cde-ae06-28c48b3f388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:55.360173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 891/1782] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:55.374435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:55.376292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:55.504430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4ac57-62ff-4e3d-b776-0b12b9eeee84 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:55.508818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:55.510223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:55.510504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:55.511246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:55.523373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:55.528850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:55.544039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 892/1783] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:55 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:56.107338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:56.300638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc2556-fb57-4cde-ae06-28c48b3f388c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:56.314146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc2556-fb57-4cde-ae06-28c48b3f388c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:56.318612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dd0c7-551d-46e2-96f1-f5aa1f9f57c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:56.319488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd0c7-551d-46e2-96f1-f5aa1f9f57c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:56.319926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd0c7-551d-46e2-96f1-f5aa1f9f57c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:56.320348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd0c7-551d-46e2-96f1-f5aa1f9f57c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:56.334283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-151dd0c7-551d-46e2-96f1-f5aa1f9f57c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:56.506206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:56.542315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dd0c7-551d-46e2-96f1-f5aa1f9f57c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:56.545510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dd0c7-551d-46e2-96f1-f5aa1f9f57c4 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:56.562126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 892/1784] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:56 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:09:57.228702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:57.232938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:57.354895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:57.588736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67861c10-05a2-4e23-a4aa-05c1f57248cc service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:57.643662 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:57.648018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:57.650077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:57.652531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] PATH_INFO: `/v3/projects/190d7f35b0f94c069b2a97fcbfc8bbfa` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:57.656720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190d7f35b0f94c069b2a97fcbfc8bbfa)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:57.662561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:57.902119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190d7f35b0f94c069b2a97fcbfc8bbfa', 'request_id': 'req-f3a3421d-3669-4c45-991b-98a044111401'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:57.920018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190d7f35b0f94c069b2a97fcbfc8bbfa', 'request_id': 'req-f3a3421d-3669-4c45-991b-98a044111401'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:57.936719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190d7f35b0f94c069b2a97fcbfc8bbfa', 'request_id': 'req-f3a3421d-3669-4c45-991b-98a044111401'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:58.021034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] The token cache is being invalidate because project 190d7f35b0f94c069b2a97fcbfc8bbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:09:58.026948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:58.026948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f3a3421d-3669-4c45-991b-98a044111401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:09:58.026948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 893/1785] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:09:57 2022] DELETE /identity/v3/projects/190d7f35b0f94c069b2a97fcbfc8bbfa => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:09:58.033976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832fbb-89c2-40b8-a191-fef5b6c7c839 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:58.035050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832fbb-89c2-40b8-a191-fef5b6c7c839 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:58.035050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832fbb-89c2-40b8-a191-fef5b6c7c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:58.077714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f3832fbb-89c2-40b8-a191-fef5b6c7c839 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:58.079752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f3832fbb-89c2-40b8-a191-fef5b6c7c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:58.325124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 893/1786] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:58.330042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4961acb-b749-4b03-8699-ece3a7ea6ad4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:58.330571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4961acb-b749-4b03-8699-ece3a7ea6ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:58.331089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4961acb-b749-4b03-8699-ece3a7ea6ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:58.371016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b4961acb-b749-4b03-8699-ece3a7ea6ad4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:58.382727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b4961acb-b749-4b03-8699-ece3a7ea6ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:58.428909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 894/1787] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:58.431194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3832fbb-89c2-40b8-a191-fef5b6c7c839 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:58.450049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3832fbb-89c2-40b8-a191-fef5b6c7c839 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:58.473180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de9431-b9cc-4999-b953-98ab0fce2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:58.474370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de9431-b9cc-4999-b953-98ab0fce2f65 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:58.475041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de9431-b9cc-4999-b953-98ab0fce2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:58.475526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de9431-b9cc-4999-b953-98ab0fce2f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:58.484143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0a52b-a869-4c4d-b4c1-4c270884ad10 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:58.484333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de9431-b9cc-4999-b953-98ab0fce2f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:09:58.484421 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0a52b-a869-4c4d-b4c1-4c270884ad10 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:58.484625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de9431-b9cc-4999-b953-98ab0fce2f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:58.484760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0a52b-a869-4c4d-b4c1-4c270884ad10 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:58.486080 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 895/1788] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:09:58.486394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de9431-b9cc-4999-b953-98ab0fce2f65 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:58.540937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 894/1789] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:09:58.541479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0a52b-a869-4c4d-b4c1-4c270884ad10 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:58.581275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:58.582169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0a52b-a869-4c4d-b4c1-4c270884ad10 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:58.591104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:58.592345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:58.592345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:58.601744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:58.603585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:58.609120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:58.629949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df342ab-6355-4dd3-bde1-4579987f19d5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:58.631065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df342ab-6355-4dd3-bde1-4579987f19d5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:58.631487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df342ab-6355-4dd3-bde1-4579987f19d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:58.677914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2df342ab-6355-4dd3-bde1-4579987f19d5 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:58.680313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2df342ab-6355-4dd3-bde1-4579987f19d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:58.719911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 896/1790] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:09:58 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:58.753874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:58.863212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 895/1791] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:58.941436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412ef93-4bc1-45a9-ac15-b60552f744f3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:58.959286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:09:58.976766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:58.976766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:58.976766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:58.976766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:58.977336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:58.977336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:59.148374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 897/1792] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:09:58 2022] POST /identity/v3/users => generated 293 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:09:59.152051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df342ab-6355-4dd3-bde1-4579987f19d5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:59.175138 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df342ab-6355-4dd3-bde1-4579987f19d5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:59.190491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:59.191332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:59.194681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:59.195395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:59.198593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:59.203756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:59.219924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:59.223097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:59.262886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 896/1793] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:59.266091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:59.312316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95728d-1159-4e9f-84cb-86f613d3da38 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:59.352447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:59.354564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:59.362133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:59.362591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:59.365026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:59.378509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:59.409142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 897/1794] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:09:59.410443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:59.425640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b15cd3-f736-401f-b9e7-dd35eec4d93f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:59.437480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516b0c1-43de-4af4-919a-b67f6fc646d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:59.444567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516b0c1-43de-4af4-919a-b67f6fc646d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:59.444567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516b0c1-43de-4af4-919a-b67f6fc646d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:59.444567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516b0c1-43de-4af4-919a-b67f6fc646d2 admin admin] PATH_INFO: `/v3/projects/7134cb5906eb4ba0aa1ef62b72a9c119/users/8f8fee5e3759468ba512a50fc3b5b6ff/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:59.475984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516b0c1-43de-4af4-919a-b67f6fc646d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7134cb5906eb4ba0aa1ef62b72a9c119, user_id=8f8fee5e3759468ba512a50fc3b5b6ff, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:59.478806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516b0c1-43de-4af4-919a-b67f6fc646d2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:59.512884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205d9e-6b7e-4858-8715-4410bac05f9c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:09:59.540086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:09:59.544123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:59.545723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:59.546543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:59.570683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:09:59.573052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:09:59.589277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 898/1795] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:09:59 2022] PUT /identity/v3/projects/7134cb5906eb4ba0aa1ef62b72a9c119/users/8f8fee5e3759468ba512a50fc3b5b6ff/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:09:59.607211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b1ca-4579-4bdc-ac49-281554985e88 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:09:59.607553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b1ca-4579-4bdc-ac49-281554985e88 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:09:59.607769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949b1ca-4579-4bdc-ac49-281554985e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:09:59.632096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 898/1796] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:09:59.679568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9949b1ca-4579-4bdc-ac49-281554985e88 None None] MFA Rules not processed for user `8f8fee5e3759468ba512a50fc3b5b6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:09:59.701066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9949b1ca-4579-4bdc-ac49-281554985e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:59.877022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 899/1797] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:09:59.896469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:09:59.898122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:09:59.980073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3860d-9f65-4308-a595-148ea1a6eef9 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:00.069544 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9de96-3af4-4f9c-baf5-7cf936b7cd55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:00.070206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9de96-3af4-4f9c-baf5-7cf936b7cd55 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:00.070495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9de96-3af4-4f9c-baf5-7cf936b7cd55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:00.070800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9de96-3af4-4f9c-baf5-7cf936b7cd55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:00.078276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:00.083276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9de96-3af4-4f9c-baf5-7cf936b7cd55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:00.084794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9de96-3af4-4f9c-baf5-7cf936b7cd55 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:00.095709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 899/1798] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:09:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:00.115472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949b1ca-4579-4bdc-ac49-281554985e88 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:00.288451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949b1ca-4579-4bdc-ac49-281554985e88 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:00.296862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:00.298059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:00.298059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:00.298434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] PATH_INFO: `/v3/users/8f8fee5e3759468ba512a50fc3b5b6ff` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:00.300212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8fee5e3759468ba512a50fc3b5b6ff)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:00.302592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:00.551559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8fee5e3759468ba512a50fc3b5b6ff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:00.551559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8fee5e3759468ba512a50fc3b5b6ff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:00.667864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8fee5e3759468ba512a50fc3b5b6ff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:00.679969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8fee5e3759468ba512a50fc3b5b6ff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:00.706870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8fee5e3759468ba512a50fc3b5b6ff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:00.715746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 900/1799] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:00 2022] DELETE /identity/v3/users/8f8fee5e3759468ba512a50fc3b5b6ff => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:00.720399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:00.720916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:00.720992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:00.749714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:00.752169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:00.841392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 900/1800] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:00.851789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:00.853560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:00.921347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082d13e-c06b-4dc5-9b5e-819d93df44d3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:00.925289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e386d13-f27a-4f80-8878-999ada9fbbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:00.925991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386d13-f27a-4f80-8878-999ada9fbbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:00.926339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386d13-f27a-4f80-8878-999ada9fbbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:00.926626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386d13-f27a-4f80-8878-999ada9fbbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:00.937738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e386d13-f27a-4f80-8878-999ada9fbbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:00.939198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e386d13-f27a-4f80-8878-999ada9fbbc6 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:00.950328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 901/1801] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:01.454085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:01.455712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:01.471570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730c62-a910-4cc8-a190-c0c4c121f0f1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:01.479400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:01.481075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:01.481970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:01.482244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] PATH_INFO: `/v3/projects/7134cb5906eb4ba0aa1ef62b72a9c119` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:01.484481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7134cb5906eb4ba0aa1ef62b72a9c119)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:01.486578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:01.677338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7134cb5906eb4ba0aa1ef62b72a9c119', 'request_id': 'req-228fa7dd-acb6-49cb-ac25-c444088462d5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:01.686393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7134cb5906eb4ba0aa1ef62b72a9c119', 'request_id': 'req-228fa7dd-acb6-49cb-ac25-c444088462d5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:01.716962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7134cb5906eb4ba0aa1ef62b72a9c119', 'request_id': 'req-228fa7dd-acb6-49cb-ac25-c444088462d5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:01.810963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] The token cache is being invalidate because project 7134cb5906eb4ba0aa1ef62b72a9c119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:01.811903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:01.813048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-228fa7dd-acb6-49cb-ac25-c444088462d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:01.815402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 901/1802] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:01 2022] DELETE /identity/v3/projects/7134cb5906eb4ba0aa1ef62b72a9c119 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:01.820596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c37ac-2a52-41f7-85d1-b386739629e0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:01.821036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c37ac-2a52-41f7-85d1-b386739629e0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:01.821467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c37ac-2a52-41f7-85d1-b386739629e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:01.852990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c19c37ac-2a52-41f7-85d1-b386739629e0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:01.854783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c19c37ac-2a52-41f7-85d1-b386739629e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:01.923638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 902/1803] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:01.933395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47871bb7-74a3-43c6-bc42-3ca20e1a8ef3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:01.933973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47871bb7-74a3-43c6-bc42-3ca20e1a8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:01.934256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47871bb7-74a3-43c6-bc42-3ca20e1a8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:01.955887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-47871bb7-74a3-43c6-bc42-3ca20e1a8ef3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:01.957210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-47871bb7-74a3-43c6-bc42-3ca20e1a8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:01.965514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 902/1804] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:01.969900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c37ac-2a52-41f7-85d1-b386739629e0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:01.973350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:01.981501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c37ac-2a52-41f7-85d1-b386739629e0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:01.986324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:01.986939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:01.987241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:01.987519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:01.988165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:01.988471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:01.990281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:02.002649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 903/1805] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:02.006844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47871bb7-74a3-43c6-bc42-3ca20e1a8ef3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:02.016992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47871bb7-74a3-43c6-bc42-3ca20e1a8ef3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:02.021541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:02.022194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:02.022521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:02.022805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:02.023414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:02.025840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:02.140061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 903/1806] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:02 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:02.144162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:02.155052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154eae-52ff-4767-a2b4-fb3d720afe33 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:02.214676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:02.215210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:02.215497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:02.215775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:02.216410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:02.218389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:02.295574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 904/1807] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:02 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:02.299646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:02.310769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2087a-026b-49ba-8767-aab1a2592a34 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:02.315587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:02.316197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:02.316482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:02.316756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:02.317396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:02.319064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:02.329742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 904/1808] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:02.333993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:02.344853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f8a30-b316-4383-a545-24479637e165 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:02.349807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce241-5a4b-4845-a2f9-483761a496c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:02.350409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce241-5a4b-4845-a2f9-483761a496c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:02.350694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce241-5a4b-4845-a2f9-483761a496c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:02.350970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce241-5a4b-4845-a2f9-483761a496c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:02.351653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce241-5a4b-4845-a2f9-483761a496c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:02.353276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce241-5a4b-4845-a2f9-483761a496c4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:02.363932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 905/1809] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:02.368100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:02.378417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb15caa-6d52-4b76-9252-3592aad4806f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:02.382976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:02.383625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:02.386849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:02.386849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] PATH_INFO: `/v3/projects/09a63586acc1459aba36b6fa91ee9d12/users/71584bffb74044179613caa94fe2e9cb/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:02.401480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a63586acc1459aba36b6fa91ee9d12, user_id=71584bffb74044179613caa94fe2e9cb, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:02.404223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:02.420941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:02.478594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 905/1810] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:02 2022] PUT /identity/v3/projects/09a63586acc1459aba36b6fa91ee9d12/users/71584bffb74044179613caa94fe2e9cb/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:02.488820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b96f-5bae-461e-82ff-a7051069a1d8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:02.489105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b96f-5bae-461e-82ff-a7051069a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:02.489432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b96f-5bae-461e-82ff-a7051069a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:02.534404 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9a48b96f-5bae-461e-82ff-a7051069a1d8 None None] MFA Rules not processed for user `71584bffb74044179613caa94fe2e9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:02.536910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9a48b96f-5bae-461e-82ff-a7051069a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:02.613993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 906/1811] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:02.618930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:02.700083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00199fb6-ae72-4015-912f-ec92bdaa4a0e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:02.705433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:02.706093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:02.706519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:02.706802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:02.707473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:02.709667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:02.889727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 906/1812] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:02 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:02.891537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b96f-5bae-461e-82ff-a7051069a1d8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:02.914799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b96f-5bae-461e-82ff-a7051069a1d8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:03.022507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:03.024100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:03.024392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:03.024786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:03.031199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:03.035247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:03.159020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 907/1813] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:02 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:03.160596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:03.172782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac894695-35e3-43be-b401-d721da1a4737 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:03.179281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:03.180239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:03.180585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:03.181010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:03.181897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:03.183745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:03.198150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 907/1814] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:03.202306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:03.214736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2689-a599-4694-8707-8a3fd89a9f85 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:03.220006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:03.220681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:03.221102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:03.221239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] PATH_INFO: `/v3/projects/9772ebb4cf32480488d52afb23a314d3/users/3a1349817a4342c4928f756b7b4924ed/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:03.241074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9772ebb4cf32480488d52afb23a314d3, user_id=3a1349817a4342c4928f756b7b4924ed, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:03.244014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:03.375633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 908/1815] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:03 2022] PUT /identity/v3/projects/9772ebb4cf32480488d52afb23a314d3/users/3a1349817a4342c4928f756b7b4924ed/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:03.377855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:03.395151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee25f1-629e-4231-a81a-517a4d2fbb51 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:03.560167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aea85d-e1f3-4f08-9502-0b09e2e56509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:03.563191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aea85d-e1f3-4f08-9502-0b09e2e56509 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:03.563698 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aea85d-e1f3-4f08-9502-0b09e2e56509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:03.565075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aea85d-e1f3-4f08-9502-0b09e2e56509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:03.576717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aea85d-e1f3-4f08-9502-0b09e2e56509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:03.583069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aea85d-e1f3-4f08-9502-0b09e2e56509 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:03.603510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 908/1816] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:03.608796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:03.621692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:03.626756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c7d7c-f310-4c9b-b54a-3a9e75a589dc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:03.634065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:03.635996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:03.645755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:03.645755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] PATH_INFO: `/v3/projects/9772ebb4cf32480488d52afb23a314d3/users/3a1349817a4342c4928f756b7b4924ed/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:03.645755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9772ebb4cf32480488d52afb23a314d3, user_id=3a1349817a4342c4928f756b7b4924ed, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:03.645755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:03.668238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 909/1817] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:03 2022] PUT /identity/v3/projects/9772ebb4cf32480488d52afb23a314d3/users/3a1349817a4342c4928f756b7b4924ed/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:03.672137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:03.672444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:03.672731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:03.721750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] MFA Rules not processed for user `3a1349817a4342c4928f756b7b4924ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:03.723030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:03.810986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 909/1818] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:03.823965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:03.828777 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:03.901323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556855f-dae7-4fb7-a613-7c82853d351b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:03.904975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:03.905691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:03.906074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:03.906344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:03.964475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:03.965971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:03.975024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 910/1819] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:04.762590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:05.004637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:05.006111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:05.073687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120b1e1-d3e7-4314-b547-a47cd977b13c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:05.078205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:05.078832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:05.079110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:05.079383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] PATH_INFO: `/v3/users/5a757a875c914bdcb5a3f873f3993aee` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:05.080522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a757a875c914bdcb5a3f873f3993aee)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:05.084890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:05.311264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a757a875c914bdcb5a3f873f3993aee'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.424931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:05.426457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:05.443639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a757a875c914bdcb5a3f873f3993aee'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.455600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdfcf1-c95d-4584-abbe-7b2d49aed124 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:05.456446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a757a875c914bdcb5a3f873f3993aee'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.457675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a757a875c914bdcb5a3f873f3993aee'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.490093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:05.492442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:05.492983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:05.493414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] PATH_INFO: `/v3/users/e319f5e07a0e44c78ebcc8a2d6f64688` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:05.498147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e319f5e07a0e44c78ebcc8a2d6f64688)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:05.501198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:05.506683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c9406e74-f938-4d8c-985f-7e84b3727456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a757a875c914bdcb5a3f873f3993aee'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.521942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 910/1820] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:05 2022] DELETE /identity/v3/users/5a757a875c914bdcb5a3f873f3993aee => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:05.523828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:05.524165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:05.524507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:05.549589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:05.551059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:05.644891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 911/1821] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:05.716269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:05.718111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:05.815183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7bcc4-cde4-4905-bac9-d7b39a16d406 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:05.836758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff9828-4cfd-4aea-81be-1a1c39b73f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:05.836758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9828-4cfd-4aea-81be-1a1c39b73f3c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:05.836758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9828-4cfd-4aea-81be-1a1c39b73f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:05.836758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff9828-4cfd-4aea-81be-1a1c39b73f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:05.859603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff9828-4cfd-4aea-81be-1a1c39b73f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:05.861230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff9828-4cfd-4aea-81be-1a1c39b73f3c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:05.879212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 912/1822] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:05.881743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98b290-e853-4f7b-8a2e-985cf3630645 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:05.885572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98b290-e853-4f7b-8a2e-985cf3630645 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:05.885691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e319f5e07a0e44c78ebcc8a2d6f64688'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.885836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98b290-e853-4f7b-8a2e-985cf3630645 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:05.885836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 913/1823] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:10:05.885968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e319f5e07a0e44c78ebcc8a2d6f64688'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.893565 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:05.894286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:05.894628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:05.921540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:05.924884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:05.970619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e319f5e07a0e44c78ebcc8a2d6f64688'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:05.982072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e319f5e07a0e44c78ebcc8a2d6f64688'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:06.011815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3f278661-6150-4139-9ae2-8f595a2f7eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e319f5e07a0e44c78ebcc8a2d6f64688'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:06.031981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 911/1824] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:05 2022] DELETE /identity/v3/users/e319f5e07a0e44c78ebcc8a2d6f64688 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:06.035768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:06.036114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:06.036400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:06.079472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:06.080872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:06.127034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 914/1825] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:06.220931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 912/1826] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:06.255889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:06.257937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:06.274363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd583d-7cbf-4546-a053-4a2be4b1ceed None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:06.342850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:06.343261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:06.343496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:06.343802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:06.356191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:06.357569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:06.384652 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 915/1827] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:06.414422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:06.417426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:06.489583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:06.518284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1d406-d10c-4740-af7c-71df49ef606c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:06.525041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:06.526787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:06.527168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:06.527750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:06.538040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:06.539717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:06.552920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 913/1828] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:06.716526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:06.721050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:06.740803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428ff22-72e9-4590-9892-2104cb476764 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:06.746594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:06.747232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:06.747556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:06.747834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] PATH_INFO: `/v3/users/5f171be0d74c43e5818bdf65f05d0d68` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:06.748960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f171be0d74c43e5818bdf65f05d0d68)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:06.750975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:06.792461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:06.794081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:06.826370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598b0b1-6b1e-40bf-ac1b-1e561b075b53 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:06.831504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:06.832215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:06.832564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:06.832849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] PATH_INFO: `/v3/projects/ce22cc0573d84f69a015a7c5b8040a26` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:06.834058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce22cc0573d84f69a015a7c5b8040a26)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:06.835952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:07.000700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f171be0d74c43e5818bdf65f05d0d68'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.006344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce22cc0573d84f69a015a7c5b8040a26', 'request_id': 'req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.013325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce22cc0573d84f69a015a7c5b8040a26', 'request_id': 'req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.019733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce22cc0573d84f69a015a7c5b8040a26', 'request_id': 'req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.118103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f171be0d74c43e5818bdf65f05d0d68'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.127695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f171be0d74c43e5818bdf65f05d0d68'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.128599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f171be0d74c43e5818bdf65f05d0d68'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.145486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f171be0d74c43e5818bdf65f05d0d68'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.153823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 916/1829] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:06 2022] DELETE /identity/v3/users/5f171be0d74c43e5818bdf65f05d0d68 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:07.156820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:07.156963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.221423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] The token cache is being invalidate because project ce22cc0573d84f69a015a7c5b8040a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:07.222547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.223433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ac12c6f8-4bf1-49f0-9b94-bbab2a662d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.229275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 914/1830] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:06 2022] DELETE /identity/v3/projects/ce22cc0573d84f69a015a7c5b8040a26 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:07.229567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089e1cf-398d-438d-b6ee-fda753d3c09e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:07.230887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.231181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.231495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.235005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:07.235648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.236040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.236243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] PATH_INFO: `/v3/projects/fe85157156e340539b6292ed9fe8ca64` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.238002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe85157156e340539b6292ed9fe8ca64)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:07.240992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:07.252203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:07.253415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.278112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 915/1831] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:07.279581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:07.281548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.294469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135efb9-2eb3-44ef-9cd7-8d1e02fc202d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:07.299479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:07.300313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.300631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.301083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] PATH_INFO: `/v3/users/71fc009ebb574560b6b712c3aca8b808` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.302259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fc009ebb574560b6b712c3aca8b808)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:07.307985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:07.399603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe85157156e340539b6292ed9fe8ca64', 'request_id': 'req-68d763db-82ac-42a3-a1ac-4133221861de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.405694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe85157156e340539b6292ed9fe8ca64', 'request_id': 'req-68d763db-82ac-42a3-a1ac-4133221861de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.413464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe85157156e340539b6292ed9fe8ca64', 'request_id': 'req-68d763db-82ac-42a3-a1ac-4133221861de'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.496825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] The token cache is being invalidate because project fe85157156e340539b6292ed9fe8ca64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:07.497556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.500525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.510437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 917/1832] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:07 2022] DELETE /identity/v3/projects/fe85157156e340539b6292ed9fe8ca64 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:07.511103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:07.513683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.556371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:07.571294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fc009ebb574560b6b712c3aca8b808'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.571294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fc009ebb574560b6b712c3aca8b808'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.621905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d763db-82ac-42a3-a1ac-4133221861de admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:07.635495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f53cc-d008-4969-a3ed-2da98b2f6a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:07.636941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f53cc-d008-4969-a3ed-2da98b2f6a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.637381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f53cc-d008-4969-a3ed-2da98b2f6a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.637780 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f53cc-d008-4969-a3ed-2da98b2f6a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.640723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b54f53cc-d008-4969-a3ed-2da98b2f6a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.671954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fc009ebb574560b6b712c3aca8b808'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.690755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fc009ebb574560b6b712c3aca8b808'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.728039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fc009ebb574560b6b712c3aca8b808'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:07.746089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 916/1833] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:07 2022] DELETE /identity/v3/users/71fc009ebb574560b6b712c3aca8b808 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:07.751322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:07.753247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.818141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f53cc-d008-4969-a3ed-2da98b2f6a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:07.820426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f53cc-d008-4969-a3ed-2da98b2f6a92 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:07.852125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 918/1834] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:07.853958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57576b-3570-4eb1-8c9e-20dc64350ec6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.854315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57576b-3570-4eb1-8c9e-20dc64350ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.855444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57576b-3570-4eb1-8c9e-20dc64350ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.884716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7c57576b-3570-4eb1-8c9e-20dc64350ec6 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:07.887535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7c57576b-3570-4eb1-8c9e-20dc64350ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.890900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a18f1-1b40-49f6-bed9-a209cb46b991 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:07.897828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:07.898635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.901244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.901244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] PATH_INFO: `/v3/users/71584bffb74044179613caa94fe2e9cb` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.901709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71584bffb74044179613caa94fe2e9cb)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:07.904218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:07.908927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 919/1835] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:07.910771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6945f0-095f-4762-b7d3-a0651c36e620 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.911630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6945f0-095f-4762-b7d3-a0651c36e620 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.911956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6945f0-095f-4762-b7d3-a0651c36e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.949819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5c6945f0-095f-4762-b7d3-a0651c36e620 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:07.951067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5c6945f0-095f-4762-b7d3-a0651c36e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:07.962823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 920/1836] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:07.971334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6945f0-095f-4762-b7d3-a0651c36e620 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:07.985622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6945f0-095f-4762-b7d3-a0651c36e620 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:07.991622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:07.992270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:07.992556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:07.992907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:07.993909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:07.994519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:07.996954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.017821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 921/1837] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:08.020979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.036035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61a4a0-d458-4d92-8889-491dae00bcfd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.044902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:08.046064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.046546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.046833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.047725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:08.051108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.107937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71584bffb74044179613caa94fe2e9cb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.108752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71584bffb74044179613caa94fe2e9cb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.176628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 922/1838] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:08 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:08.186519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.192935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71584bffb74044179613caa94fe2e9cb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.205998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71584bffb74044179613caa94fe2e9cb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.223689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-736d5567-d3fa-4b4d-9e4a-3438c7dae957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71584bffb74044179613caa94fe2e9cb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.234874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 917/1839] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:07 2022] DELETE /identity/v3/users/71584bffb74044179613caa94fe2e9cb => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:08.239342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.240049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.240049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.266268 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:08.268236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:08.330752 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89abce-c263-4a0f-92a5-9c0ba15a3abf admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.435134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:08.436457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.436932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.439625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.439871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:08.442292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.461502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 918/1840] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:08.484228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.487180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:08.563870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578ffbb-8388-4135-a80c-d909e2594c78 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.569422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:08.570078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.570359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.570631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.583122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:08.585801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.585932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 923/1841] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:08 2022] POST /identity/v3/users => generated 283 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:08.590287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.600868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:08.608558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 919/1842] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:08.613360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:08.621993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715a8e-d141-446a-8f09-a74de9c6608d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.627609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:08.628295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.628642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.628983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.630170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:08.631778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.646107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 924/1843] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:08.648589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.660502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d820-f93b-4df5-8d1f-bf4835cb364f service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.666078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:08.666078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.676034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.676034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.676034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:08.676034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.677900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.679819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:08.683575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 920/1844] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:08.684440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.704370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb2809-5fbe-4097-982a-af62f26f2aac admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.704835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:08.705858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.706360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.706892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] PATH_INFO: `/v3/projects/b548cc31d388492ca69f40d3d4d44c9f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.708463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b548cc31d388492ca69f40d3d4d44c9f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:08.710942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.715264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9ef7b-9701-49f9-af19-29881c04747b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.728458 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:08.730106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:08.732508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:08.732508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] PATH_INFO: `/v3/projects/7ee28f0d8463471086fbea2419e97606/users/4fef3c356a04476589933e918fd76995/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:08.759425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee28f0d8463471086fbea2419e97606, user_id=4fef3c356a04476589933e918fd76995, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:08.765247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:08.851472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:08.868485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 921/1845] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:08 2022] PUT /identity/v3/projects/7ee28f0d8463471086fbea2419e97606/users/4fef3c356a04476589933e918fd76995/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:08.870224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:08.877003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:08.881794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b548cc31d388492ca69f40d3d4d44c9f', 'request_id': 'req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.888774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b548cc31d388492ca69f40d3d4d44c9f', 'request_id': 'req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.896528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b548cc31d388492ca69f40d3d4d44c9f', 'request_id': 'req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.996446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] The token cache is being invalidate because project b548cc31d388492ca69f40d3d4d44c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:08.996821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.997693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ca74edc-e5f6-497b-aa30-fd9d5e783d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:08.999442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29ce3-0f5d-4897-8a87-a89726046bae admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:08.999655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 925/1846] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:08 2022] DELETE /identity/v3/projects/b548cc31d388492ca69f40d3d4d44c9f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:09.001111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.001906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.002288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.052161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] MFA Rules not processed for user `4fef3c356a04476589933e918fd76995`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:09.055243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.085811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:09.087041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.087394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.087761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] PATH_INFO: `/v3/projects/da5253b12fb448c3b30180d9bea1d50a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.089298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5253b12fb448c3b30180d9bea1d50a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:09.091307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:09.144779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 926/1847] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:09.149130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:09.152237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.164134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0580bc-10e0-41a7-8e2d-16eba8519857 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:09.170450 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:09.171623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.172115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.172562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] PATH_INFO: `/v3/users/8b36a7c477c543d2a9524b09d8020e1f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.175703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b36a7c477c543d2a9524b09d8020e1f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:09.177780 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:09.217332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5253b12fb448c3b30180d9bea1d50a', 'request_id': 'req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.223875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5253b12fb448c3b30180d9bea1d50a', 'request_id': 'req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.230829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5253b12fb448c3b30180d9bea1d50a', 'request_id': 'req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.356397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] The token cache is being invalidate because project da5253b12fb448c3b30180d9bea1d50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:09.356695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.357349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.364883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 922/1848] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:08 2022] DELETE /identity/v3/projects/da5253b12fb448c3b30180d9bea1d50a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:09.364883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:09.364883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.425465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03ebc2-6a7d-41e0-98d7-1a946877d9d7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:09.430179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:09.430793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.431078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.431357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.432016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:09.434024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:09.449814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b36a7c477c543d2a9524b09d8020e1f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.523597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 923/1849] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:09 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:09.524601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:09.529228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.529999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b36a7c477c543d2a9524b09d8020e1f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.538107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b36a7c477c543d2a9524b09d8020e1f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.542316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b36a7c477c543d2a9524b09d8020e1f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.558230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8b85eb5f-7524-4bda-a430-d05bead412ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b36a7c477c543d2a9524b09d8020e1f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.564988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 927/1850] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:09 2022] DELETE /identity/v3/users/8b36a7c477c543d2a9524b09d8020e1f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:09.565814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.566176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.566524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.591810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:09.593444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.594969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc16ef-fd5a-4fcb-902b-8577a152369f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:09.664434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:09.665425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.665860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.666954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] PATH_INFO: `/v3/projects/09a63586acc1459aba36b6fa91ee9d12` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.668237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a63586acc1459aba36b6fa91ee9d12)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:09.670309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:09.684190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 928/1851] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:09.685031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:09.686332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.706682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac5ee9-180c-4271-b3f9-e20ec17e2230 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:09.712459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b4956-6d91-4a98-838a-8c14169e8110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:09.713875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4956-6d91-4a98-838a-8c14169e8110 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.714363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4956-6d91-4a98-838a-8c14169e8110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.714613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4956-6d91-4a98-838a-8c14169e8110 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.715761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4956-6d91-4a98-838a-8c14169e8110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:09.717826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4956-6d91-4a98-838a-8c14169e8110 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:09.831879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a63586acc1459aba36b6fa91ee9d12', 'request_id': 'req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.838424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a63586acc1459aba36b6fa91ee9d12', 'request_id': 'req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.843790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a63586acc1459aba36b6fa91ee9d12', 'request_id': 'req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.861218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 929/1852] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:09 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:09.862563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:09.862847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:09.863591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:09.890093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:09.891441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.952832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] The token cache is being invalidate because project 09a63586acc1459aba36b6fa91ee9d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:09.953329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.954135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:09.956375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 924/1853] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:09 2022] DELETE /identity/v3/projects/09a63586acc1459aba36b6fa91ee9d12 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:09.957720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:09.960596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:09.986389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 930/1854] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:09.987597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:09.989807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:10.019361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c418b0f-3c39-46ce-97f2-b0b82abbda69 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.030382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.032230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.032657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.033248 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] PATH_INFO: `/v3/users/3a1349817a4342c4928f756b7b4924ed` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.034768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1349817a4342c4928f756b7b4924ed)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.037439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.093277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e8ba2-86c9-44e3-9dc2-11097a5831e2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.098343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.098971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.099509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.099783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.100428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.102225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.117663 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 925/1855] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:10.118582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:10.129428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee17e7-2bea-46b7-8b91-1d426b668c4e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.138255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.139463 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.139751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.140071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.140744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:10.141030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.142662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.168380 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 926/1856] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:10.171580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:10.180237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9030f3-2276-4f3e-91ce-81578e258e42 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.186081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.186925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.187212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.187485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] PATH_INFO: `/v3/projects/7a71f79c257540ba887ef7fba78882d2/users/c49a827ba10e42afbda96798f45fce74/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.218521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a71f79c257540ba887ef7fba78882d2, user_id=c49a827ba10e42afbda96798f45fce74, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.223797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.232977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:10.260417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1349817a4342c4928f756b7b4924ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.340586 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1349817a4342c4928f756b7b4924ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.347595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 927/1857] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:10 2022] PUT /identity/v3/projects/7a71f79c257540ba887ef7fba78882d2/users/c49a827ba10e42afbda96798f45fce74/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:10.348142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:10.350013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:10.352628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1349817a4342c4928f756b7b4924ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.353375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1349817a4342c4928f756b7b4924ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.367495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1349817a4342c4928f756b7b4924ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.376605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 931/1858] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:09 2022] DELETE /identity/v3/users/3a1349817a4342c4928f756b7b4924ed => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:10.377533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:10.378971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:10.429804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1225-3351-4685-9e1e-ba66d93cbd99 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.474033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa5fe5-3ce7-48f7-9a82-26ec3723a75e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.482281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.483337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.483963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.484348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.485277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.487478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.512961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.513725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.514261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.514577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] PATH_INFO: `/v3/projects/623dec3ca991411489765895ccb47cd4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.515811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] RBAC: Authorizing `identity:delete_project(project_id=623dec3ca991411489765895ccb47cd4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.517974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.602680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 932/1859] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:10 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:10.604667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:10.606861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:10.659731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623dec3ca991411489765895ccb47cd4', 'request_id': 'req-4896d06f-f475-4813-ac8e-e022d23d93af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.672761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623dec3ca991411489765895ccb47cd4', 'request_id': 'req-4896d06f-f475-4813-ac8e-e022d23d93af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.695982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623dec3ca991411489765895ccb47cd4', 'request_id': 'req-4896d06f-f475-4813-ac8e-e022d23d93af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.751333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37988b2-c1c8-47d6-abe0-445d439daea8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.802618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] The token cache is being invalidate because project 623dec3ca991411489765895ccb47cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:10.802916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.804570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:10.812891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 928/1860] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:10 2022] DELETE /identity/v3/projects/623dec3ca991411489765895ccb47cd4 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:10.815370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:10.817145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:10.848136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da802ee6-2305-47a9-8742-1ff8f3551e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.848993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da802ee6-2305-47a9-8742-1ff8f3551e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.849593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da802ee6-2305-47a9-8742-1ff8f3551e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.850038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da802ee6-2305-47a9-8742-1ff8f3551e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.850808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da802ee6-2305-47a9-8742-1ff8f3551e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.862911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da802ee6-2305-47a9-8742-1ff8f3551e41 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.877173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 933/1861] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:10.878755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.879051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.879330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.902962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:10.904268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:10.913840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 934/1862] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:10.914702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:10.915800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896d06f-f475-4813-ac8e-e022d23d93af admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.916724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:10.922440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca5402-3812-465b-8ab5-883721534475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.923874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5402-3812-465b-8ab5-883721534475 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.925054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5402-3812-465b-8ab5-883721534475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.925323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5402-3812-465b-8ab5-883721534475 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.926351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca5402-3812-465b-8ab5-883721534475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.929142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca5402-3812-465b-8ab5-883721534475 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.935920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc90e-e575-42b2-b070-36e160483c5b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:10.950635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e2f6-1705-41fc-92c4-3f3cc9f3c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:10.952314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e2f6-1705-41fc-92c4-3f3cc9f3c383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.952532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e2f6-1705-41fc-92c4-3f3cc9f3c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.952820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e2f6-1705-41fc-92c4-3f3cc9f3c383 admin admin] PATH_INFO: `/v3/projects/7a71f79c257540ba887ef7fba78882d2/users/c49a827ba10e42afbda96798f45fce74/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.955640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0e2f6-1705-41fc-92c4-3f3cc9f3c383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a71f79c257540ba887ef7fba78882d2, user_id=c49a827ba10e42afbda96798f45fce74, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:10.958325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0e2f6-1705-41fc-92c4-3f3cc9f3c383 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:10.969916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 935/1863] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:10 2022] PUT /identity/v3/projects/7a71f79c257540ba887ef7fba78882d2/users/c49a827ba10e42afbda96798f45fce74/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:10.971234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ee4bd-3252-48cd-b63e-6db9d6a5c870 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:10.971522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ee4bd-3252-48cd-b63e-6db9d6a5c870 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:10.971869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ee4bd-3252-48cd-b63e-6db9d6a5c870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:10.994273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4d4ee4bd-3252-48cd-b63e-6db9d6a5c870 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:10.996439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4d4ee4bd-3252-48cd-b63e-6db9d6a5c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.045618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 929/1864] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:10 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:11.045618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a823-263e-4551-b760-2f93db6722ae None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.045618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a823-263e-4551-b760-2f93db6722ae None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.045618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793a823-263e-4551-b760-2f93db6722ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.091844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f793a823-263e-4551-b760-2f93db6722ae None None] MFA Rules not processed for user `c49a827ba10e42afbda96798f45fce74`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:11.093128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f793a823-263e-4551-b760-2f93db6722ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.103375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 936/1865] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:11.103375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ee4bd-3252-48cd-b63e-6db9d6a5c870 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.111410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ee4bd-3252-48cd-b63e-6db9d6a5c870 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.116171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.116794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.117599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.117599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.117996 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.120215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.133343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 937/1866] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:11.134598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.148196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6704d-71de-49dc-b44e-6d3359db9796 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.156957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.157388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.157740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.158118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.158846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:11.159226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.161682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.189055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 938/1867] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:11.189055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.191363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.204231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 930/1868] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:11.205631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54c8d-9b71-4062-a765-94379d948fe8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.206672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a823-263e-4551-b760-2f93db6722ae None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.214621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.215764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.215764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.215764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] PATH_INFO: `/v3/projects/9772ebb4cf32480488d52afb23a314d3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.216905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9772ebb4cf32480488d52afb23a314d3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.218993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.223739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793a823-263e-4551-b760-2f93db6722ae None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.230252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.230877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.232600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.232899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.233561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.235554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.246913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 931/1869] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:11.247786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.258037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b01101-d675-4f96-9f9f-7be628daab23 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.263387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.264018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.264261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.264542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.265224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.266826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:11.270967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.399897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 932/1870] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:11 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:11.401452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.403245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.437972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9772ebb4cf32480488d52afb23a314d3', 'request_id': 'req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:11.446038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9772ebb4cf32480488d52afb23a314d3', 'request_id': 'req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:11.455041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9772ebb4cf32480488d52afb23a314d3', 'request_id': 'req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:11.494289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4f90b-1393-474a-8352-0227f4f1ed96 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.498084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.498729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.499017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.499295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.543688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] The token cache is being invalidate because project 9772ebb4cf32480488d52afb23a314d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:11.544070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:11.544845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:11.547492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 939/1871] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:11 2022] DELETE /identity/v3/projects/9772ebb4cf32480488d52afb23a314d3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:11.548321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.550741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.582497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.584117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.596341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 933/1872] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:11.597353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.632427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908835f1-6c5c-49a5-a4ab-bdbbb99e4323 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.666414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d025b-e55c-400a-8912-a78ca7e4fb8a service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.672037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739b6a5-ecba-4911-b938-f58584e70df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.672836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b6a5-ecba-4911-b938-f58584e70df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.673116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b6a5-ecba-4911-b938-f58584e70df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.673388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739b6a5-ecba-4911-b938-f58584e70df3 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.674053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b6a5-ecba-4911-b938-f58584e70df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.675958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739b6a5-ecba-4911-b938-f58584e70df3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.691618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.692282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.692569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.692849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] PATH_INFO: `/v3/projects/88f10d61d8bf4a0d99f94fb4a1e4594e/users/c5575e3c7c304eb5848304c901c5845f/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.708365 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f10d61d8bf4a0d99f94fb4a1e4594e, user_id=c5575e3c7c304eb5848304c901c5845f, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.711330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.764616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 934/1873] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:11 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:11.766394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c533fa-5cc8-4e72-88e9-9fd33d967cb1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.766878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c533fa-5cc8-4e72-88e9-9fd33d967cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.768524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c533fa-5cc8-4e72-88e9-9fd33d967cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.797862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a2c533fa-5cc8-4e72-88e9-9fd33d967cb1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:11.799196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a2c533fa-5cc8-4e72-88e9-9fd33d967cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.808728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 940/1874] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:11 2022] PUT /identity/v3/projects/88f10d61d8bf4a0d99f94fb4a1e4594e/users/c5575e3c7c304eb5848304c901c5845f/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:11.810063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:11.812103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.885038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 935/1875] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:11.897550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb290-3a21-40b3-b0fb-088fccbf181f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.897550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb290-3a21-40b3-b0fb-088fccbf181f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.897550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eb290-3a21-40b3-b0fb-088fccbf181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.898161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590c8b1-5005-475e-9064-a0132ba68fa7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:11.906066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652ac06-90ef-4e5d-b652-17b16eb38c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:11.906695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ac06-90ef-4e5d-b652-17b16eb38c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.906975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ac06-90ef-4e5d-b652-17b16eb38c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.907258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ac06-90ef-4e5d-b652-17b16eb38c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.907970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652ac06-90ef-4e5d-b652-17b16eb38c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:11.909631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652ac06-90ef-4e5d-b652-17b16eb38c20 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:11.931036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 941/1876] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:11.933264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a6143-db2f-47c4-9ccb-a22425d809be None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:11.933606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a6143-db2f-47c4-9ccb-a22425d809be None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:11.934089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a6143-db2f-47c4-9ccb-a22425d809be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:11.962206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-504a6143-db2f-47c4-9ccb-a22425d809be None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:11.963749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-504a6143-db2f-47c4-9ccb-a22425d809be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.979045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7f5eb290-3a21-40b3-b0fb-088fccbf181f None None] MFA Rules not processed for user `c5575e3c7c304eb5848304c901c5845f`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:11.980801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7f5eb290-3a21-40b3-b0fb-088fccbf181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:11.984790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 942/1877] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:11.986567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a6143-db2f-47c4-9ccb-a22425d809be None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.006098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a6143-db2f-47c4-9ccb-a22425d809be None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.013598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.014255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.014594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.014879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.016037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.018515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.032506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 943/1878] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:12.033390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.047271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e6ebf-a0f8-4fb6-80d9-8b5255c80b6d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.054251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.054965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.055305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.055585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.056233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:12.060115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.060115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.072208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 944/1879] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:12.074246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.078136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 936/1880] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:12.082329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eb290-3a21-40b3-b0fb-088fccbf181f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.089818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac697f-1868-44e1-a3b0-718587dae9c9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.094525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.095188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.095468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.095798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] PATH_INFO: `/v3/projects/fa90d796e7ce40fdb7683242fdbc5c8b/users/75b8d8ee91c54b1d956069b7389befa5/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.106770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eb290-3a21-40b3-b0fb-088fccbf181f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.111605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c42ba0-993c-471c-a791-222a3f85e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.112223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c42ba0-993c-471c-a791-222a3f85e023 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.117035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c42ba0-993c-471c-a791-222a3f85e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.117035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c42ba0-993c-471c-a791-222a3f85e023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.117324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa90d796e7ce40fdb7683242fdbc5c8b, user_id=75b8d8ee91c54b1d956069b7389befa5, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.117406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c42ba0-993c-471c-a791-222a3f85e023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.117406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c42ba0-993c-471c-a791-222a3f85e023 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.117552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.232966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 945/1881] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:12 2022] PUT /identity/v3/projects/fa90d796e7ce40fdb7683242fdbc5c8b/users/75b8d8ee91c54b1d956069b7389befa5/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:12.233994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.285517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 937/1882] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:12 2022] POST /identity/v3/projects => generated 363 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:12.285517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c86c7-0f05-459b-a5c5-75ae590f4629 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.285517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c86c7-0f05-459b-a5c5-75ae590f4629 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.285517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c86c7-0f05-459b-a5c5-75ae590f4629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.300253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52218916-38c3-45df-a627-c54c8517114e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.314504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1e2c86c7-0f05-459b-a5c5-75ae590f4629 None None] MFA Rules not processed for user `75b8d8ee91c54b1d956069b7389befa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:12.316057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1e2c86c7-0f05-459b-a5c5-75ae590f4629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:12.365316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.365962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.366244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.366521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.367182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.369230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.381502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 938/1883] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:12.385378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c86c7-0f05-459b-a5c5-75ae590f4629 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.392870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c86c7-0f05-459b-a5c5-75ae590f4629 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.397407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.398045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.398332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.398610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.399271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.401841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.430508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:12.507089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 946/1884] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:12 2022] POST /identity/v3/projects => generated 379 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:12.508557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.534821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 939/1885] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:12 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:12.534821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.546579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0d5d8-93ca-4952-b43b-500975ab3d1c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.591323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4767b2-fa37-40a9-98b8-7185c1af1fd1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.598152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.598921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.599030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.599564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.600201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.602475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.639332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.640039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.640410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.640745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.641441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.643392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.738846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 940/1886] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:12 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:12.742540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.745273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 947/1887] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:12 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:12.746355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.753551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59310d8-ff5e-480b-8a49-25563f230aa5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.839114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4983c3-e759-40e0-b7a2-82286a3670b3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.844484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.845179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.845452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.845725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.846371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.854014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.854431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.854431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.854431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.854431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.854687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.854756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.865269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 948/1888] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:12.865269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.865668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 941/1889] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:12.865668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.867004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:12.882409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c33bfd-9030-4b34-a7e9-4c4c1bac97b3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.888166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de77ba8-bd8b-4eca-a7fa-3d5693d513fe admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.890010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.890653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.890935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.891208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] PATH_INFO: `/v3/users/4fef3c356a04476589933e918fd76995` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.892488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fef3c356a04476589933e918fd76995)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.892931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.893541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.893889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.894173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.894459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.894808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.896717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:12.921774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:12.975140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 949/1890] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:12 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:12.976057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:12.987475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e1bbb-8498-4ac9-b1c2-b8863185d561 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:12.992778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:12.993452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:12.993778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:12.994677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:12.996796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:12.997287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.008479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 950/1891] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:13.009375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.019385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d8c9-4bea-4803-97be-7703d667aae4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.024370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.024954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.025237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.025544 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.026167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.027750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.038300 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 951/1892] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:13.038756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.051357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f95a1-1612-4378-9947-a60d5f2cc9c8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.057117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.057711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.058097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.058375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.059014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.060602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.060703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fef3c356a04476589933e918fd76995'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:13.061371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fef3c356a04476589933e918fd76995'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:13.070644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 952/1893] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:13.071445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.081162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c046a9-761d-4c81-adbf-7b6e268c71dc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.085714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.086374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.086658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.086934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] PATH_INFO: `/v3/projects/50c319b1aa5c45a8aadb7c9a8d8ee93d/users/896d00942b4c498492c86fc7dd33eef0/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.102506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c319b1aa5c45a8aadb7c9a8d8ee93d, user_id=896d00942b4c498492c86fc7dd33eef0, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.107921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.129332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fef3c356a04476589933e918fd76995'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:13.139985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fef3c356a04476589933e918fd76995'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:13.162445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fef3c356a04476589933e918fd76995'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:13.176177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 942/1894] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:12 2022] DELETE /identity/v3/users/4fef3c356a04476589933e918fd76995 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:13.179189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.181745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.250870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738607-d33a-40db-9ad1-8ab02ae5fbd3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.256034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a54ae2-fd87-44b4-b59c-95bbd6e97cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.256734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a54ae2-fd87-44b4-b59c-95bbd6e97cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.257021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a54ae2-fd87-44b4-b59c-95bbd6e97cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.257299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a54ae2-fd87-44b4-b59c-95bbd6e97cd9 admin admin] PATH_INFO: `/v3/projects/bb5b87c75cea4041890816348157f2ca/users/f0f0d32dfe614e55af8b1e1e0743eda4/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.272642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 953/1895] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:13 2022] PUT /identity/v3/projects/50c319b1aa5c45a8aadb7c9a8d8ee93d/users/896d00942b4c498492c86fc7dd33eef0/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:13.272895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a54ae2-fd87-44b4-b59c-95bbd6e97cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5b87c75cea4041890816348157f2ca, user_id=f0f0d32dfe614e55af8b1e1e0743eda4, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.273270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.274845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.276242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a54ae2-fd87-44b4-b59c-95bbd6e97cd9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.351252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8bc25-310d-40cf-bce3-ff55bc896fb8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.356958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc199f-3ea7-422a-b552-08a765987aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.357720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc199f-3ea7-422a-b552-08a765987aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.358432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc199f-3ea7-422a-b552-08a765987aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.359132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc199f-3ea7-422a-b552-08a765987aa1 admin admin] PATH_INFO: `/v3/projects/3e922d5279384930afa604a28e9d0431/users/76273b0d4a1f4f628cb4e6946dbe5144/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.375473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc199f-3ea7-422a-b552-08a765987aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e922d5279384930afa604a28e9d0431, user_id=76273b0d4a1f4f628cb4e6946dbe5144, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.378278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc199f-3ea7-422a-b552-08a765987aa1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.381787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 943/1896] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:13 2022] PUT /identity/v3/projects/bb5b87c75cea4041890816348157f2ca/users/f0f0d32dfe614e55af8b1e1e0743eda4/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:13.383891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e06a-7e9d-48d5-8213-cdc82792fb6a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.384276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e06a-7e9d-48d5-8213-cdc82792fb6a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.385704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92e06a-7e9d-48d5-8213-cdc82792fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.405118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3a92e06a-7e9d-48d5-8213-cdc82792fb6a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:13.406298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3a92e06a-7e9d-48d5-8213-cdc82792fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.454454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 954/1897] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:13 2022] PUT /identity/v3/projects/3e922d5279384930afa604a28e9d0431/users/76273b0d4a1f4f628cb4e6946dbe5144/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:13.455535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36ed1-5584-4c39-9344-70d922b893fa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.455826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36ed1-5584-4c39-9344-70d922b893fa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.456103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36ed1-5584-4c39-9344-70d922b893fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.493492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c8a36ed1-5584-4c39-9344-70d922b893fa None None] MFA Rules not processed for user `896d00942b4c498492c86fc7dd33eef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:13.495752 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c8a36ed1-5584-4c39-9344-70d922b893fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.513400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 944/1898] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:13.514959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.515409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.515746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.550174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] MFA Rules not processed for user `f0f0d32dfe614e55af8b1e1e0743eda4`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:13.551962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.614500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 955/1899] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:13.615693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36ed1-5584-4c39-9344-70d922b893fa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.667441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 945/1900] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:13.672537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.676739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.705147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36ed1-5584-4c39-9344-70d922b893fa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.710476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.711089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.711382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.711735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.712522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.714805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.726640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 956/1901] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:13.727594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.731574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.745386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3bf38-d9d2-407b-b9f5-95cfff1b2e67 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.751151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.751770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.752052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.752330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.752998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.754957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.767867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd869a-be19-4970-bb78-8ca1c9001445 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.777266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.778472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.779007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.779479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.792921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:13.794627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:13.804608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 946/1902] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:13.813172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.815354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:13.877111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 957/1903] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:13 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:13.878359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:13.908907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8c4b9-9dca-48d9-b92f-04dc5f699a23 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:13.966541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb53ea2-95fe-485a-ae85-c83b5e815fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:13.967700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53ea2-95fe-485a-ae85-c83b5e815fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:13.968163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53ea2-95fe-485a-ae85-c83b5e815fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:13.968445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53ea2-95fe-485a-ae85-c83b5e815fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:13.996811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313eee2e-b39a-4852-9c19-e91e8288700b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.013411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.016778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.016778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.016778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] PATH_INFO: `/v3/projects/3e922d5279384930afa604a28e9d0431/users/76273b0d4a1f4f628cb4e6946dbe5144/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.018720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e922d5279384930afa604a28e9d0431, user_id=76273b0d4a1f4f628cb4e6946dbe5144, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.023380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.061264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 958/1904] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:13 2022] PUT /identity/v3/projects/3e922d5279384930afa604a28e9d0431/users/76273b0d4a1f4f628cb4e6946dbe5144/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:14.062315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.084389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb53ea2-95fe-485a-ae85-c83b5e815fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.086587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb53ea2-95fe-485a-ae85-c83b5e815fb7 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.112306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 947/1905] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:14.112306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.112306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.112306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.158543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] MFA Rules not processed for user `76273b0d4a1f4f628cb4e6946dbe5144`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:14.161790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:14.190226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da39115-59b8-4874-9e78-08d65782f290 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.206103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.206738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.207025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.207339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.207949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.210608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.267171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 948/1906] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:14.283441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.286162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:14.349850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 959/1907] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:14 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:14.354801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.366802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622f22-4074-45d2-b479-f64b8740a506 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.372724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.373350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.373633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.373963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.374598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.376234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.380431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357f9a2-3cc8-41a5-926b-106084e82bdc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.384153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.384830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.385080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.385395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.386897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 960/1908] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:14.391242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.402384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e807baf-4e6c-4401-8017-b2d5715fb122 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.408358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.409830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.409830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.409830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] PATH_INFO: `/v3/projects/ce83be18cbe94b869491728fc6011069/users/7f249c3566d4457e9fe1bec7168ef755/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.411001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.413098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.425501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 949/1909] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:14.427428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce83be18cbe94b869491728fc6011069, user_id=7f249c3566d4457e9fe1bec7168ef755, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.430510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.504995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 961/1910] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:14 2022] PUT /identity/v3/projects/ce83be18cbe94b869491728fc6011069/users/7f249c3566d4457e9fe1bec7168ef755/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:14.509221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.519877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa96da-880e-45d7-8645-513c8cf5140d service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.577472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.578378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.578712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.578975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.579631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.581388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.599541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 950/1911] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:14.604356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.616115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839aaef-3f5e-42eb-a6a4-47c0031da2a3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.616983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.622059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bff1c-a773-438e-8169-00d603a5236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.622727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bff1c-a773-438e-8169-00d603a5236c admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.623016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bff1c-a773-438e-8169-00d603a5236c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.623293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bff1c-a773-438e-8169-00d603a5236c admin admin] PATH_INFO: `/v3/projects/ce83be18cbe94b869491728fc6011069/users/7f249c3566d4457e9fe1bec7168ef755/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.626314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bff1c-a773-438e-8169-00d603a5236c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce83be18cbe94b869491728fc6011069, user_id=7f249c3566d4457e9fe1bec7168ef755, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.629324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bff1c-a773-438e-8169-00d603a5236c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.649323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 962/1912] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:14 2022] PUT /identity/v3/projects/ce83be18cbe94b869491728fc6011069/users/7f249c3566d4457e9fe1bec7168ef755/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:14.662011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.662694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.663422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.689094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:14.694280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944a67-eb4a-4f55-92ea-5ea3d59e012f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.702034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] MFA Rules not processed for user `7f249c3566d4457e9fe1bec7168ef755`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:14.703704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:14.766533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.767447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.767723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.767980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.769875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:14.794902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 963/1913] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:14.831028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.832502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.844238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 951/1914] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:14.861422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.866763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:14.867203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:14.890089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40d7a6-8bd9-472b-9368-bfe0a5276a3e service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:14.904051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:14.905075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:14.905808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:14.905995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:14.932413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:14.934865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:14.946267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 952/1915] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:15.006933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a35e2-4802-4817-b907-7a7c36028efa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:15.023937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:15.024720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:15.024998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:15.026503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] PATH_INFO: `/v3/projects/7ee28f0d8463471086fbea2419e97606` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:15.027743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee28f0d8463471086fbea2419e97606)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:15.029929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:15.065353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:15.085422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:15.093934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444420f7-7a44-4579-a1ba-99a800dcc805 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:15.098176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:15.098948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:15.102369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:15.102369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:15.102369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:15.204814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:15.207517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:15.214440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee28f0d8463471086fbea2419e97606', 'request_id': 'req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.221528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 953/1916] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:15.226675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee28f0d8463471086fbea2419e97606', 'request_id': 'req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.237914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee28f0d8463471086fbea2419e97606', 'request_id': 'req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.348863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] The token cache is being invalidate because project 7ee28f0d8463471086fbea2419e97606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:15.349668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.354542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.356860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 964/1917] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:14 2022] DELETE /identity/v3/projects/7ee28f0d8463471086fbea2419e97606 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:15.360567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:15.378543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a029641-37e3-4388-9059-14f46fdb4eef service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:15.511201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:15.512122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:15.512122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:15.512406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] PATH_INFO: `/v3/users/c49a827ba10e42afbda96798f45fce74` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:15.515862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49a827ba10e42afbda96798f45fce74)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:15.520218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:15.731047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:15.738047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:15.749289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e1d2-6bc1-4ea3-98a9-50e33af4a41b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:15.755247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:15.755931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:15.756181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:15.756477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] PATH_INFO: `/v3/users/75b8d8ee91c54b1d956069b7389befa5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:15.757616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b8d8ee91c54b1d956069b7389befa5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:15.765256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:15.827621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49a827ba10e42afbda96798f45fce74'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.828273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49a827ba10e42afbda96798f45fce74'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.916588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49a827ba10e42afbda96798f45fce74'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.925195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49a827ba10e42afbda96798f45fce74'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.953604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cd01d3d4-7943-4a30-97d3-7e8a17ecd8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49a827ba10e42afbda96798f45fce74'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:15.961094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 954/1918] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:15 2022] DELETE /identity/v3/users/c49a827ba10e42afbda96798f45fce74 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:15.968756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b8d8ee91c54b1d956069b7389befa5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:16.054790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b8d8ee91c54b1d956069b7389befa5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:16.076554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b8d8ee91c54b1d956069b7389befa5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:16.079904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b8d8ee91c54b1d956069b7389befa5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:16.101577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b8d8ee91c54b1d956069b7389befa5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:16.109314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 965/1919] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:15 2022] DELETE /identity/v3/users/75b8d8ee91c54b1d956069b7389befa5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:16.114116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:16.114592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:16.115033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:16.142003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:16.143443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:16.258422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 955/1920] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:16.269984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:16.272920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:16.360786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa9f26-8470-4fac-b050-4799fb30e34d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:16.375058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c505c-50af-4a1e-bdd4-db8e32a06ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:16.375948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c505c-50af-4a1e-bdd4-db8e32a06ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:16.376374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c505c-50af-4a1e-bdd4-db8e32a06ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:16.376786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c505c-50af-4a1e-bdd4-db8e32a06ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:16.417812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c505c-50af-4a1e-bdd4-db8e32a06ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:16.420700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c505c-50af-4a1e-bdd4-db8e32a06ccf service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:16.445746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 966/1921] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:16.614744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:16.809145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:16.811090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:16.827704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610751c4-6745-4ff5-abd6-5a9fccc0b0d5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:16.842230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:16.847849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:16.855707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:16.855707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:16.855707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] PATH_INFO: `/v3/projects/7a71f79c257540ba887ef7fba78882d2` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:16.855707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a71f79c257540ba887ef7fba78882d2)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:16.855707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:16.984843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a71f79c257540ba887ef7fba78882d2', 'request_id': 'req-9010541b-205e-428f-ba8c-0b43b26d6737'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:16.992763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a71f79c257540ba887ef7fba78882d2', 'request_id': 'req-9010541b-205e-428f-ba8c-0b43b26d6737'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.000685 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a71f79c257540ba887ef7fba78882d2', 'request_id': 'req-9010541b-205e-428f-ba8c-0b43b26d6737'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.074474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] The token cache is being invalidate because project 7a71f79c257540ba887ef7fba78882d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:17.074474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.074474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.075562 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 956/1922] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:16 2022] DELETE /identity/v3/projects/7a71f79c257540ba887ef7fba78882d2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:17.084972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03e69-9d20-4bc0-9983-97e9035c417b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.084972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03e69-9d20-4bc0-9983-97e9035c417b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.084972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03e69-9d20-4bc0-9983-97e9035c417b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.102021 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ddf03e69-9d20-4bc0-9983-97e9035c417b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:17.103999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ddf03e69-9d20-4bc0-9983-97e9035c417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:17.164474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.167222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:17.230183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 967/1923] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:17.240060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e87b0-7107-44b9-8bec-580bbf117cfc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.240499 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e87b0-7107-44b9-8bec-580bbf117cfc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.240709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e87b0-7107-44b9-8bec-580bbf117cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.265407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-558e87b0-7107-44b9-8bec-580bbf117cfc None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:17.266832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-558e87b0-7107-44b9-8bec-580bbf117cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:17.280565 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 968/1924] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:17.281808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e87b0-7107-44b9-8bec-580bbf117cfc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.292332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e87b0-7107-44b9-8bec-580bbf117cfc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.301996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010541b-205e-428f-ba8c-0b43b26d6737 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.309734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.310806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.311706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.312498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] PATH_INFO: `/v3/projects/fa90d796e7ce40fdb7683242fdbc5c8b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.314167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa90d796e7ce40fdb7683242fdbc5c8b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.316551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.342481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.344554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.348082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.348657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.350983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:17.351306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.355475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.388449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 969/1925] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:10:17.389433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.415130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865fdd6-e285-4aa0-9b38-41204fcdb77a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.421283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.421999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.422317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.422598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.423250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.425528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.510358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa90d796e7ce40fdb7683242fdbc5c8b', 'request_id': 'req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.529617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa90d796e7ce40fdb7683242fdbc5c8b', 'request_id': 'req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.538183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa90d796e7ce40fdb7683242fdbc5c8b', 'request_id': 'req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.543582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 970/1926] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:17 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:17.547731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.616519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] The token cache is being invalidate because project fa90d796e7ce40fdb7683242fdbc5c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:17.617394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.618503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.625314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 957/1927] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:17 2022] DELETE /identity/v3/projects/fa90d796e7ce40fdb7683242fdbc5c8b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:17.626703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.628363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:17.657404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f1181-e963-4478-832b-8ab7bf758cda admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.671290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.672193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.672474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.672744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.673381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.675470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.742656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be0d4-d95e-4d6b-8ec1-8b8651ae2f7d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.749861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.751056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.755028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.755028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] PATH_INFO: `/v3/users/76273b0d4a1f4f628cb4e6946dbe5144` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.755028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76273b0d4a1f4f628cb4e6946dbe5144)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.756410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.815742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 971/1928] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:17 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:17.821687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.823782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:17.838825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f177b-fbe5-4d4e-96fc-fbaaf6a0d347 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.843859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.844476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.844761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.861244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.861244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.861244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.861244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 972/1929] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:17.864768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.889493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a92421-040d-4507-a7ad-26cb542e308f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.895480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.896099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.896378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.896648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.897284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.898968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.910662 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 973/1930] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:17.914893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:17.925093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc010391-bcba-4c46-b687-095f96999b0b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:17.931280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befe017-f4eb-4251-ab8c-ffe6faa33415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:17.931964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe017-f4eb-4251-ab8c-ffe6faa33415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:17.932243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe017-f4eb-4251-ab8c-ffe6faa33415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:17.932515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe017-f4eb-4251-ab8c-ffe6faa33415 admin admin] PATH_INFO: `/v3/projects/bbbca5f066df426a86803bedff949446/users/b3adcb98da5343ad9d1c70a0d5e0989a/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:17.953611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befe017-f4eb-4251-ab8c-ffe6faa33415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbca5f066df426a86803bedff949446, user_id=b3adcb98da5343ad9d1c70a0d5e0989a, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:17.957393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befe017-f4eb-4251-ab8c-ffe6faa33415 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:17.984897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76273b0d4a1f4f628cb4e6946dbe5144'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:17.986364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76273b0d4a1f4f628cb4e6946dbe5144'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:18.068204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:18.069219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76273b0d4a1f4f628cb4e6946dbe5144'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:18.079196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 974/1931] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:17 2022] PUT /identity/v3/projects/bbbca5f066df426a86803bedff949446/users/b3adcb98da5343ad9d1c70a0d5e0989a/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:18.092870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76273b0d4a1f4f628cb4e6946dbe5144'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:18.094096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b3b2-9a4e-476b-a0eb-10c81867a1c2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:18.094257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b3b2-9a4e-476b-a0eb-10c81867a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:18.094533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b3b2-9a4e-476b-a0eb-10c81867a1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:18.120962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76273b0d4a1f4f628cb4e6946dbe5144'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:18.136175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 958/1932] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:17 2022] DELETE /identity/v3/users/76273b0d4a1f4f628cb4e6946dbe5144 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:18.161125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5fa5b3b2-9a4e-476b-a0eb-10c81867a1c2 None None] MFA Rules not processed for user `b3adcb98da5343ad9d1c70a0d5e0989a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:18.163077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5fa5b3b2-9a4e-476b-a0eb-10c81867a1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:18.272641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 975/1933] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:18.274276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:18.276881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:18.366284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d95a4-9b0e-4499-be18-ffc9b0414a7a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:18.372735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:18.373575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:18.374071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:18.374496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:18.375298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:18.377525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:18.489966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 959/1934] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:18 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:18.494878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b3b2-9a4e-476b-a0eb-10c81867a1c2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:18.515836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b3b2-9a4e-476b-a0eb-10c81867a1c2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:18.617345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:18.618089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:18.618466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:18.622437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:18.623360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:18.627411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:18.751255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 976/1935] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:18 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:18.752509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:18.765140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f114df-5566-4975-a694-9c6d82de1f1e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:18.770056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:18.770675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:18.771015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:18.771334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:18.771985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:18.773610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:18.788849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 960/1936] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:18.798787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:18.828568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e027481-f20c-43c5-8a74-5446d0ed5df5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:18.837817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:18.837817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:18.837817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:18.837817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] PATH_INFO: `/v3/projects/8e92ec6f65624cb890c6171601993666/users/cc993e5339bd4a5faeea7b1ab46a67d9/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:18.890742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e92ec6f65624cb890c6171601993666, user_id=cc993e5339bd4a5faeea7b1ab46a67d9, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:18.897972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:18.907316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:18.992317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 977/1937] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:18 2022] PUT /identity/v3/projects/8e92ec6f65624cb890c6171601993666/users/cc993e5339bd4a5faeea7b1ab46a67d9/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:18.996634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:19.008266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90598f-f4dd-43ab-a99b-0d09e6f004f3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:19.079686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:19.080320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.080608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.080888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.081532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:19.083261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:19.105386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:19.105870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 961/1938] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:19.109300 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:19.109824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:19.128892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882129d-2cc8-4f4b-957b-fa03df7ec6e0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:19.130917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eacef7-a02c-4f91-9ef4-4cce12816d3c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:19.135857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:19.136082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5131259-dc9a-4355-8763-f74774f70ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:19.136755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5131259-dc9a-4355-8763-f74774f70ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.136914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.137229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.137570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] PATH_INFO: `/v3/projects/3e922d5279384930afa604a28e9d0431` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.137873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5131259-dc9a-4355-8763-f74774f70ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.138300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5131259-dc9a-4355-8763-f74774f70ce9 admin admin] PATH_INFO: `/v3/projects/8e92ec6f65624cb890c6171601993666/users/cc993e5339bd4a5faeea7b1ab46a67d9/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.140404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e922d5279384930afa604a28e9d0431)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:19.140831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5131259-dc9a-4355-8763-f74774f70ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e92ec6f65624cb890c6171601993666, user_id=cc993e5339bd4a5faeea7b1ab46a67d9, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:19.142802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:19.143781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5131259-dc9a-4355-8763-f74774f70ce9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:19.158139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 962/1939] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:19 2022] PUT /identity/v3/projects/8e92ec6f65624cb890c6171601993666/users/cc993e5339bd4a5faeea7b1ab46a67d9/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:19.176909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.177870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.178166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.223371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] MFA Rules not processed for user `cc993e5339bd4a5faeea7b1ab46a67d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:19.225541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:19.333055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e922d5279384930afa604a28e9d0431', 'request_id': 'req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:19.333055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e922d5279384930afa604a28e9d0431', 'request_id': 'req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:19.337170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e922d5279384930afa604a28e9d0431', 'request_id': 'req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:19.365675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 963/1940] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:19.373439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:19.375345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:19.440176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf9f43-d521-4a47-b085-dabac64065c3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:19.562830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949a7c5-b4ad-41f0-9343-997b694ac67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:19.562830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949a7c5-b4ad-41f0-9343-997b694ac67d service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.562830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949a7c5-b4ad-41f0-9343-997b694ac67d service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.562830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949a7c5-b4ad-41f0-9343-997b694ac67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.564545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949a7c5-b4ad-41f0-9343-997b694ac67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:19.566183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949a7c5-b4ad-41f0-9343-997b694ac67d service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:19.576316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 964/1941] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:19.648918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] The token cache is being invalidate because project 3e922d5279384930afa604a28e9d0431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:19.648918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:19.648918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8aab38c7-579e-41bf-8f4b-ea4e8a8a831d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:19.648918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 978/1942] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:19 2022] DELETE /identity/v3/projects/3e922d5279384930afa604a28e9d0431 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:19.668539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675958-61d5-43c6-902d-f040ab3aaf31 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.668961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675958-61d5-43c6-902d-f040ab3aaf31 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.669124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675958-61d5-43c6-902d-f040ab3aaf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.704504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-41675958-61d5-43c6-902d-f040ab3aaf31 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:19.705836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-41675958-61d5-43c6-902d-f040ab3aaf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:19.836839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 965/1943] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:19.839645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6edb3b-d1ed-44b6-b81d-41e3d49f4456 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.840009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6edb3b-d1ed-44b6-b81d-41e3d49f4456 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.840294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6edb3b-d1ed-44b6-b81d-41e3d49f4456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.864800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7d6edb3b-d1ed-44b6-b81d-41e3d49f4456 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:19.866068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7d6edb3b-d1ed-44b6-b81d-41e3d49f4456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:19.879588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 979/1944] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:19.884103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41675958-61d5-43c6-902d-f040ab3aaf31 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:19.895948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41675958-61d5-43c6-902d-f040ab3aaf31 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:19.901273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:19.901939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.902734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.903021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.903716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:19.904060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:19.905715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:19.919214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 966/1945] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:10:19.925685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6edb3b-d1ed-44b6-b81d-41e3d49f4456 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:19.936122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6edb3b-d1ed-44b6-b81d-41e3d49f4456 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:19.941738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:19.942386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:19.942670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:19.942945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:19.943626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:19.945720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:20.831161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 980/1946] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:19 2022] POST /identity/v3/projects => generated 383 bytes in 903 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:20.832312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:20.843627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201b1fe-927a-4416-847b-4c9446d3cd30 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:20.878413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:20.880456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:20.912071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:20.912689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:20.912974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:20.913256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:20.913929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:20.915886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:20.952114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51033cc-6448-4b79-b648-ef4f10702210 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:20.958741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:20.959420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:20.959754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:20.960012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] PATH_INFO: `/v3/users/c5575e3c7c304eb5848304c901c5845f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:20.961161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5575e3c7c304eb5848304c901c5845f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:20.963477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:20.983989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 967/1947] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:20 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:20.988421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:21.000044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c819a-90bb-4560-bc34-54f9528bb9a6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:21.009317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:21.009317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:21.009317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:21.009317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:21.010040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:21.010040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:21.019884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 968/1948] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:21.024148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:21.050637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fa29-9ccf-49ae-a6e0-90690357f59c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:21.050637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:21.050637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:21.050637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:21.050939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:21.050939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:21.050939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:21.065590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 969/1949] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:21.067504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:21.078726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55e784-5281-4ba7-99e2-9db5ed3d32de admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:21.083464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aefbc2-4b48-46b6-af25-a6caba9bf8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:21.084249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefbc2-4b48-46b6-af25-a6caba9bf8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:21.084666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefbc2-4b48-46b6-af25-a6caba9bf8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:21.084936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aefbc2-4b48-46b6-af25-a6caba9bf8c0 admin admin] PATH_INFO: `/v3/projects/e78ca1b5fd454f38a74873798038da21/users/17e1236cecdf4df1acc22040bb775ed9/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:21.104328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aefbc2-4b48-46b6-af25-a6caba9bf8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78ca1b5fd454f38a74873798038da21, user_id=17e1236cecdf4df1acc22040bb775ed9, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:21.108357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aefbc2-4b48-46b6-af25-a6caba9bf8c0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:21.214646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 970/1950] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:21 2022] PUT /identity/v3/projects/e78ca1b5fd454f38a74873798038da21/users/17e1236cecdf4df1acc22040bb775ed9/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:21.226484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:21.226793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:21.227041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:21.263339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5575e3c7c304eb5848304c901c5845f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:21.273006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] MFA Rules not processed for user `17e1236cecdf4df1acc22040bb775ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:21.274391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:21.335455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5575e3c7c304eb5848304c901c5845f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:21.349259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 971/1951] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:21.349626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5575e3c7c304eb5848304c901c5845f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:21.349626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5575e3c7c304eb5848304c901c5845f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:21.358307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:21.359823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:21.371455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8066771a-428f-48ac-9974-b3666683f7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5575e3c7c304eb5848304c901c5845f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:21.377881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 981/1952] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:20 2022] DELETE /identity/v3/users/c5575e3c7c304eb5848304c901c5845f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:21.386086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:21.386385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:21.386761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:21.409294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:21.410725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:21.428350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114534-db62-4f3b-b6a9-a64b92c39c38 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:21.471980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 982/1953] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:21.483433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:21.484930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:21.490125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:21.491010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:21.491898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:21.492303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:21.495047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:21.553186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b649047-00a5-4036-97bf-70f80d8d6b89 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:21.557072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:21.560102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:21.560102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:21.560102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:21.568578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:21.570032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:21.572464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:21.574355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:21.580784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 983/1954] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:21.585452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 972/1955] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:21.777672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:22.035877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:22.035877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:22.059350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdaa18-b119-439c-8d76-87e13d082610 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:22.073037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:22.073669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:22.073986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:22.074268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] PATH_INFO: `/v3/projects/88f10d61d8bf4a0d99f94fb4a1e4594e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:22.075435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f10d61d8bf4a0d99f94fb4a1e4594e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:22.077350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:22.287400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f10d61d8bf4a0d99f94fb4a1e4594e', 'request_id': 'req-737f9861-036d-45fa-a312-39ef364aa6cb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.295518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f10d61d8bf4a0d99f94fb4a1e4594e', 'request_id': 'req-737f9861-036d-45fa-a312-39ef364aa6cb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.302263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f10d61d8bf4a0d99f94fb4a1e4594e', 'request_id': 'req-737f9861-036d-45fa-a312-39ef364aa6cb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.376381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] The token cache is being invalidate because project 88f10d61d8bf4a0d99f94fb4a1e4594e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:22.376683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.377357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.379031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 984/1956] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:22 2022] DELETE /identity/v3/projects/88f10d61d8bf4a0d99f94fb4a1e4594e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:22.383242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:22.398679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb413acc-2981-42e1-a7ac-288adbd47f27 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:22.437281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:22.441507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:22.479761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:22.480676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:22.480676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:22.481057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] PATH_INFO: `/v3/users/896d00942b4c498492c86fc7dd33eef0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:22.482965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896d00942b4c498492c86fc7dd33eef0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:22.484932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:22.535569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f9861-036d-45fa-a312-39ef364aa6cb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:22.539415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:22.540102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:22.540445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:22.540811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:22.542822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:22.600286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:22.622211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:22.623708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:22.635564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 985/1957] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:22.685003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896d00942b4c498492c86fc7dd33eef0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.685725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896d00942b4c498492c86fc7dd33eef0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.750739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896d00942b4c498492c86fc7dd33eef0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.758541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896d00942b4c498492c86fc7dd33eef0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.771825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896d00942b4c498492c86fc7dd33eef0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:22.778833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 973/1958] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:22 2022] DELETE /identity/v3/users/896d00942b4c498492c86fc7dd33eef0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:23.313591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:23.315090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:23.364835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a21d7-2ae8-4b44-b535-1be45c37c12c service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:23.445944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:23.449207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:23.449207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:23.449207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] PATH_INFO: `/v3/projects/50c319b1aa5c45a8aadb7c9a8d8ee93d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:23.449207 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c319b1aa5c45a8aadb7c9a8d8ee93d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:23.450883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:23.540066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:23.586781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c319b1aa5c45a8aadb7c9a8d8ee93d', 'request_id': 'req-18b65306-35b0-4154-88b1-cea6e88e3168'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:23.593178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c319b1aa5c45a8aadb7c9a8d8ee93d', 'request_id': 'req-18b65306-35b0-4154-88b1-cea6e88e3168'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:23.600312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c319b1aa5c45a8aadb7c9a8d8ee93d', 'request_id': 'req-18b65306-35b0-4154-88b1-cea6e88e3168'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:23.655409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] The token cache is being invalidate because project 50c319b1aa5c45a8aadb7c9a8d8ee93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:23.655736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:23.656397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:23.667607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 986/1959] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:23 2022] DELETE /identity/v3/projects/50c319b1aa5c45a8aadb7c9a8d8ee93d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:23.671658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:23.673344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:23.687812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456bb31-54b0-4094-bf06-7e185fddf2f6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:23.769017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:23.769661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:23.770026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:23.770308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] PATH_INFO: `/v3/users/7f249c3566d4457e9fe1bec7168ef755` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:23.771444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f249c3566d4457e9fe1bec7168ef755)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:23.773420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:23.999206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f249c3566d4457e9fe1bec7168ef755'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:23.999905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f249c3566d4457e9fe1bec7168ef755'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.095423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f249c3566d4457e9fe1bec7168ef755'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.106349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f249c3566d4457e9fe1bec7168ef755'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.126395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a1c65bd-d41b-41ff-9a1e-630a092c5c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f249c3566d4457e9fe1bec7168ef755'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.138790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 974/1960] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:23 2022] DELETE /identity/v3/users/7f249c3566d4457e9fe1bec7168ef755 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:24.329445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:24.630541 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:24.632363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:24.674730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b65306-35b0-4154-88b1-cea6e88e3168 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:24.749948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:24.751508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:24.751508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:24.751508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] PATH_INFO: `/v3/projects/ce83be18cbe94b869491728fc6011069` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:24.752466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce83be18cbe94b869491728fc6011069)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:24.755433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:24.839890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce83be18cbe94b869491728fc6011069', 'request_id': 'req-a46232d7-b62f-4fc5-8fdb-43f46a79d638'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.845326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce83be18cbe94b869491728fc6011069', 'request_id': 'req-a46232d7-b62f-4fc5-8fdb-43f46a79d638'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.852057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce83be18cbe94b869491728fc6011069', 'request_id': 'req-a46232d7-b62f-4fc5-8fdb-43f46a79d638'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.901210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] The token cache is being invalidate because project ce83be18cbe94b869491728fc6011069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:24.901709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.902603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a46232d7-b62f-4fc5-8fdb-43f46a79d638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:24.904231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 987/1961] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:24 2022] DELETE /identity/v3/projects/ce83be18cbe94b869491728fc6011069 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:24.911216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3afcf-00c6-4f75-bfe8-6accf0884f86 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:24.912159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3afcf-00c6-4f75-bfe8-6accf0884f86 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:24.912786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3afcf-00c6-4f75-bfe8-6accf0884f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:24.942414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-90f3afcf-00c6-4f75-bfe8-6accf0884f86 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:24.944277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-90f3afcf-00c6-4f75-bfe8-6accf0884f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:25.022718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 975/1962] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:25.033359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36d5a7-8bbf-4b18-8f4c-decdde079f2c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.033723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36d5a7-8bbf-4b18-8f4c-decdde079f2c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.034301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36d5a7-8bbf-4b18-8f4c-decdde079f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.059324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cc36d5a7-8bbf-4b18-8f4c-decdde079f2c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:25.060561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cc36d5a7-8bbf-4b18-8f4c-decdde079f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:25.073404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 988/1963] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:25.074884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3afcf-00c6-4f75-bfe8-6accf0884f86 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:25.085151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3afcf-00c6-4f75-bfe8-6accf0884f86 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:25.093377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:25.097904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.097904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.097904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.097904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:25.097904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:25.097904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:25.111359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 976/1964] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:25.115907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36d5a7-8bbf-4b18-8f4c-decdde079f2c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:25.132593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36d5a7-8bbf-4b18-8f4c-decdde079f2c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:25.133674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:25.134381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.134731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.135090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.135919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:25.138028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:25.246769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 989/1965] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:25 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:25.250659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:25.261273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae62374-8fc8-4d92-9f89-ceeee6951edd admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:25.323924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:25.324637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.325232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.325232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.326160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:25.328273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:25.432934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 977/1966] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:25 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:25.437661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:25.454151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7d362-eef6-4ef1-a831-5b280ac04f76 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:25.459391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:25.460268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.460693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.461854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.462657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:25.464438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:25.484625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 990/1967] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:25.486949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:25.498546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce73556-dcb3-40b8-86c9-9fea6290f0e5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:25.503737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53a192-f3c7-44a9-be01-0000e1723bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:25.504427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53a192-f3c7-44a9-be01-0000e1723bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.504710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53a192-f3c7-44a9-be01-0000e1723bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.504983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53a192-f3c7-44a9-be01-0000e1723bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.505621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53a192-f3c7-44a9-be01-0000e1723bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:25.507287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53a192-f3c7-44a9-be01-0000e1723bf1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:25.518688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 978/1968] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:25.522875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:25.532928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cea51-447b-4f93-a3f8-76f912ef6891 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:25.537445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:25.538179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.538464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.538743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] PATH_INFO: `/v3/projects/1783b03cf47d4fd7a98d21bdcce47357/users/a3e6836ce5cd42a7b1868694a3af8f5f/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.553702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1783b03cf47d4fd7a98d21bdcce47357, user_id=a3e6836ce5cd42a7b1868694a3af8f5f, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:25.556418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:25.649271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 991/1969] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:25 2022] PUT /identity/v3/projects/1783b03cf47d4fd7a98d21bdcce47357/users/a3e6836ce5cd42a7b1868694a3af8f5f/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:25.661154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654915e2-5d73-4c89-a073-c4626d78f5a7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.661370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654915e2-5d73-4c89-a073-c4626d78f5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.661641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654915e2-5d73-4c89-a073-c4626d78f5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.692397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-654915e2-5d73-4c89-a073-c4626d78f5a7 None None] MFA Rules not processed for user `a3e6836ce5cd42a7b1868694a3af8f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:25.693610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-654915e2-5d73-4c89-a073-c4626d78f5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:25.736916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:25.777618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 979/1970] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:25.781548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:25.858666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af738c39-ac28-41ca-a1a9-90c038ee1105 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:25.863487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:25.864017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:25.864330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:25.864681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:25.865243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:25.868744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:25.998773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 992/1971] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:25 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:26.002894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654915e2-5d73-4c89-a073-c4626d78f5a7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:26.014451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654915e2-5d73-4c89-a073-c4626d78f5a7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:26.087754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:26.088300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:26.088688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:26.088969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:26.089785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:26.091944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:26.217792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 980/1972] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:26 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:26.219432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:26.231505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd30ff-8158-470f-9b0c-619c8775c8f1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:26.236444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:26.237110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:26.237387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:26.237712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:26.238391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:26.239982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:26.251885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 993/1973] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:26.257237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:26.266648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed1113-0cae-4bc6-a99d-84af28ea42ec admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:26.271281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:26.271989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:26.272272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:26.272548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] PATH_INFO: `/v3/projects/5c4ce71b5a674fa59e85799b39ea7894/users/e273c30aeabb412989f0de8624d01a98/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:26.289825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4ce71b5a674fa59e85799b39ea7894, user_id=e273c30aeabb412989f0de8624d01a98, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:26.292887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:26.401369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 981/1974] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:26 2022] PUT /identity/v3/projects/5c4ce71b5a674fa59e85799b39ea7894/users/e273c30aeabb412989f0de8624d01a98/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:26.406488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:26.419768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcd952-d1c1-4a73-b0ba-243704dc40f1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:26.490734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc4767-e497-43e8-b4e9-341abe9a3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:26.491471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4767-e497-43e8-b4e9-341abe9a3353 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:26.491858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4767-e497-43e8-b4e9-341abe9a3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:26.492222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4767-e497-43e8-b4e9-341abe9a3353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:26.492947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc4767-e497-43e8-b4e9-341abe9a3353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:26.495218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc4767-e497-43e8-b4e9-341abe9a3353 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:26.509540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 994/1975] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:26.511475 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:26.523156 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d58b8-4604-4f1b-992c-e0df3eca3b79 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:26.529378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:26.530085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:26.530373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:26.530651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] PATH_INFO: `/v3/projects/5c4ce71b5a674fa59e85799b39ea7894/users/e273c30aeabb412989f0de8624d01a98/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:26.532768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4ce71b5a674fa59e85799b39ea7894, user_id=e273c30aeabb412989f0de8624d01a98, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:26.535678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:26.554215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 982/1976] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:26 2022] PUT /identity/v3/projects/5c4ce71b5a674fa59e85799b39ea7894/users/e273c30aeabb412989f0de8624d01a98/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:26.559548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb69f5-7a71-4219-8277-86622e283f06 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:26.559839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb69f5-7a71-4219-8277-86622e283f06 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:26.560119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb69f5-7a71-4219-8277-86622e283f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:26.592915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8aeb69f5-7a71-4219-8277-86622e283f06 None None] MFA Rules not processed for user `e273c30aeabb412989f0de8624d01a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:26.598617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8aeb69f5-7a71-4219-8277-86622e283f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:26.709033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 995/1977] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:26.723490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:26.725505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:26.757535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:26.802490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d889-3bcf-4ba0-8fc9-c255160176ae admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:26.806286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:26.807469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:26.807756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:26.808029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:26.817942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:26.819480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:26.831486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 983/1978] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:27.108414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb69f5-7a71-4219-8277-86622e283f06 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:27.118056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb69f5-7a71-4219-8277-86622e283f06 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:27.123183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecdc74-bd3b-4598-942b-4a9c6137529a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:27.123909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdc74-bd3b-4598-942b-4a9c6137529a service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:27.124189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdc74-bd3b-4598-942b-4a9c6137529a service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:27.124488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecdc74-bd3b-4598-942b-4a9c6137529a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:27.210061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecdc74-bd3b-4598-942b-4a9c6137529a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:27.211608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eecdc74-bd3b-4598-942b-4a9c6137529a service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:27.222119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 996/1979] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:27.264601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:27.266286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:27.351640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfdd8a-53e9-40b5-9140-db379dda8d46 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:27.359137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:27.361789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:27.361789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:27.361789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] PATH_INFO: `/v3/users/b3adcb98da5343ad9d1c70a0d5e0989a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:27.362583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3adcb98da5343ad9d1c70a0d5e0989a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:27.364692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:27.404271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:27.639192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3adcb98da5343ad9d1c70a0d5e0989a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:27.639927 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3adcb98da5343ad9d1c70a0d5e0989a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:27.723276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3adcb98da5343ad9d1c70a0d5e0989a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:27.755935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3adcb98da5343ad9d1c70a0d5e0989a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:27.778082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3adcb98da5343ad9d1c70a0d5e0989a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:27.785378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 984/1980] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:27 2022] DELETE /identity/v3/users/b3adcb98da5343ad9d1c70a0d5e0989a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:27.797191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:27.797191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:27.797191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:27.832560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:27.833900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:27.911567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 997/1981] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:27.922145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:27.923812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:27.988008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f70f5-c6b9-4ff3-a619-ac655d3b0745 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:27.997909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:27.997909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:27.997909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:27.997909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:28.007033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:28.008831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:28.021146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 985/1982] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:28.180031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:28.554624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:28.556069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:28.569855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89087a-ba54-4cc4-a6e7-e6540f2da97a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:28.577266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:28.578411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:28.578698 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:28.578983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] PATH_INFO: `/v3/projects/bbbca5f066df426a86803bedff949446` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:28.580149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbca5f066df426a86803bedff949446)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:28.582354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:28.730644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:28.742664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbca5f066df426a86803bedff949446', 'request_id': 'req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:28.753909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbca5f066df426a86803bedff949446', 'request_id': 'req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:28.764116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbca5f066df426a86803bedff949446', 'request_id': 'req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:28.883814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] The token cache is being invalidate because project bbbca5f066df426a86803bedff949446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:28.884429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:28.889476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:28.889998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 998/1983] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:28 2022] DELETE /identity/v3/projects/bbbca5f066df426a86803bedff949446 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:28.891206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:28.902492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6bab9-0a78-481c-816a-2ca2226fcc5f service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:28.973063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:28.973658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:28.973967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:28.974232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] PATH_INFO: `/v3/users/cc993e5339bd4a5faeea7b1ab46a67d9` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:28.975662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc993e5339bd4a5faeea7b1ab46a67d9)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:28.977732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:29.200544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc993e5339bd4a5faeea7b1ab46a67d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.201325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc993e5339bd4a5faeea7b1ab46a67d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.272024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc993e5339bd4a5faeea7b1ab46a67d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.281910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc993e5339bd4a5faeea7b1ab46a67d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.297599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc993e5339bd4a5faeea7b1ab46a67d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.304808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 986/1984] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:28 2022] DELETE /identity/v3/users/cc993e5339bd4a5faeea7b1ab46a67d9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:29.541004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:29.543397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:29.571851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9bf7d-2dfe-4e9d-85d2-3201e23d8cde admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:29.659174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:29.659855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:29.660142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:29.660422 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] PATH_INFO: `/v3/users/17e1236cecdf4df1acc22040bb775ed9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:29.661578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e1236cecdf4df1acc22040bb775ed9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:29.663733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:29.863269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e1236cecdf4df1acc22040bb775ed9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.866522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:29.869127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:29.888276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b587f-d399-44bb-b4ba-d9a2e00841da admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:29.894299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:29.895639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:29.896075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:29.896497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] PATH_INFO: `/v3/projects/8e92ec6f65624cb890c6171601993666` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:29.900099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e92ec6f65624cb890c6171601993666)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:29.903533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:29.951109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e1236cecdf4df1acc22040bb775ed9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.960797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e1236cecdf4df1acc22040bb775ed9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.963710 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e1236cecdf4df1acc22040bb775ed9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.977947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1ced3ae1-c8dd-4f65-8929-240da3c33fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e1236cecdf4df1acc22040bb775ed9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:29.986313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 999/1985] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:29 2022] DELETE /identity/v3/users/17e1236cecdf4df1acc22040bb775ed9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:29.991087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:29.991373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:29.991814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.019239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:30.021237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:30.021344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e92ec6f65624cb890c6171601993666', 'request_id': 'req-aada17ba-e443-4fb8-925a-6183f340a675'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:30.031022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e92ec6f65624cb890c6171601993666', 'request_id': 'req-aada17ba-e443-4fb8-925a-6183f340a675'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:30.037524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e92ec6f65624cb890c6171601993666', 'request_id': 'req-aada17ba-e443-4fb8-925a-6183f340a675'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:30.094655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1000/1986] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:30.105015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.106471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:30.128385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] The token cache is being invalidate because project 8e92ec6f65624cb890c6171601993666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:30.128684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:30.129316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aada17ba-e443-4fb8-925a-6183f340a675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:30.130843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 987/1987] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:29 2022] DELETE /identity/v3/projects/8e92ec6f65624cb890c6171601993666 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:30.140189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d04f-39d5-4b39-8222-2b8ecc322585 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.140479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d04f-39d5-4b39-8222-2b8ecc322585 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.140757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61d04f-39d5-4b39-8222-2b8ecc322585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.164676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a630d-0098-4f20-8998-3b2d2bdbbc51 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:30.165195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9b61d04f-39d5-4b39-8222-2b8ecc322585 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:30.166736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9b61d04f-39d5-4b39-8222-2b8ecc322585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:30.169009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:30.169631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.169951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.170229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.171924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:30.176460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 988/1988] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:30.184827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba93a3-5b15-4b1f-8336-0c2cd163a0f8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.185113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba93a3-5b15-4b1f-8336-0c2cd163a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.185381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba93a3-5b15-4b1f-8336-0c2cd163a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.186850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:30.188327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:30.199518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1001/1989] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:30.207250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1fba93a3-5b15-4b1f-8336-0c2cd163a0f8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:30.208301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1fba93a3-5b15-4b1f-8336-0c2cd163a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:30.221108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 989/1990] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:30.222295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.234015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e7677-ed2d-4935-b8f7-022e8808c72f service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:30.240198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:30.241225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.241509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.241842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.242510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:30.242923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:30.245682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:30.273583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1002/1991] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:30.274793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba93a3-5b15-4b1f-8336-0c2cd163a0f8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.286499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba93a3-5b15-4b1f-8336-0c2cd163a0f8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:30.292496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:30.293247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.293536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.293844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.294506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:30.296568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:30.426668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 990/1992] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:30 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:30.430664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.454711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd9b3-173d-4584-b5fd-7a17c881296d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:30.535298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:30.547151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:30.547703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.548190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.548461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.549117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:30.551100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:30.575602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:30.643777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1003/1993] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:30 2022] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:30.647703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.673122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eca857-fbf1-4880-adf2-cde6b825f7b3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:30.681211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:30.682920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.683386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.683890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.684713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:30.686671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:30.701815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 991/1994] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:30.705979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.719183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a115fb-d258-417d-a57f-78295fdc7968 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:30.730289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:30.731090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.731871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.732251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.733005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:30.734952 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:30.748242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1004/1995] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:30.752497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.766708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c02bb-84d8-49ef-9415-bfe8e8a700ce admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:30.772402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266581d-c13e-4591-b35d-3533b42ed45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:30.773093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266581d-c13e-4591-b35d-3533b42ed45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.773390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266581d-c13e-4591-b35d-3533b42ed45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.773725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266581d-c13e-4591-b35d-3533b42ed45b admin admin] PATH_INFO: `/v3/projects/6b727d0add9744639daf28734f07c3d7/users/ff35fdef68e147398bc06ef7ebdc2424/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.791631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266581d-c13e-4591-b35d-3533b42ed45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b727d0add9744639daf28734f07c3d7, user_id=ff35fdef68e147398bc06ef7ebdc2424, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:30.794623 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266581d-c13e-4591-b35d-3533b42ed45b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:30.910313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:30.912100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:30.926426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 992/1996] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:30 2022] PUT /identity/v3/projects/6b727d0add9744639daf28734f07c3d7/users/ff35fdef68e147398bc06ef7ebdc2424/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:30.928869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:30.930427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:30.930873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:30.939235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59c97-24e1-45e5-a2ab-e75b0c39d4e0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:31.003611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] MFA Rules not processed for user `ff35fdef68e147398bc06ef7ebdc2424`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:31.005347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.061423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:31.066999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.067792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.068226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] PATH_INFO: `/v3/projects/e78ca1b5fd454f38a74873798038da21` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.070587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78ca1b5fd454f38a74873798038da21)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:31.073343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:31.100493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 993/1997] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:31.257004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78ca1b5fd454f38a74873798038da21', 'request_id': 'req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.269596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:31.271196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.271881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78ca1b5fd454f38a74873798038da21', 'request_id': 'req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.279852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78ca1b5fd454f38a74873798038da21', 'request_id': 'req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.341473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a832f57-add3-44ae-ac83-1b3c211120d1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:31.387779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] The token cache is being invalidate because project e78ca1b5fd454f38a74873798038da21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:31.388440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.390569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3292ab0b-46e8-42ac-ac1c-3d1ea058ff77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.392235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1005/1998] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:30 2022] DELETE /identity/v3/projects/e78ca1b5fd454f38a74873798038da21 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:31.397171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4948-ea1f-4037-bbb5-b8c28b1b1d73 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.397171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4948-ea1f-4037-bbb5-b8c28b1b1d73 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.397171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4948-ea1f-4037-bbb5-b8c28b1b1d73 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.397171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1006/1999] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:10:31.399231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52a919-ab1e-412a-ab6d-6249da8ce367 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.399847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52a919-ab1e-412a-ab6d-6249da8ce367 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.401811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52a919-ab1e-412a-ab6d-6249da8ce367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.454625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dc52a919-ab1e-412a-ab6d-6249da8ce367 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:31.454625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dc52a919-ab1e-412a-ab6d-6249da8ce367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.461700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe12cbf-6afe-481d-bd77-c4290df86616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:31.462820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12cbf-6afe-481d-bd77-c4290df86616 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.463234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12cbf-6afe-481d-bd77-c4290df86616 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.463656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe12cbf-6afe-481d-bd77-c4290df86616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.465932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7fe12cbf-6afe-481d-bd77-c4290df86616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.526749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1007/2000] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:31.528083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.528369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.528644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.535308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe12cbf-6afe-481d-bd77-c4290df86616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:31.536770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe12cbf-6afe-481d-bd77-c4290df86616 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:31.547486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 994/2001] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:31.548951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.549246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.549528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.565947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:31.574653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.587695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:31.589626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.601900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 995/2002] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:31.601900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:31.604588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.618234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4436b1-f7b7-4973-affc-85d658d49617 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:31.630352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:31.630352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.630352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.630352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] PATH_INFO: `/v3/users/6e93bd4c42014ccd82e8277aae7dcc01` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.630743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e93bd4c42014ccd82e8277aae7dcc01)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:31.630743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:31.644331 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1008/2003] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:10:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:31.645259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:31.646630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:31.661775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c45cae-17df-418a-83e6-464c54114059 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:31.666423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:31.667077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:31.667363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:31.667637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] PATH_INFO: `/v3/users/ff35fdef68e147398bc06ef7ebdc2424` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:31.668763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff35fdef68e147398bc06ef7ebdc2424)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:31.670703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:31.864236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e93bd4c42014ccd82e8277aae7dcc01'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.865151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e93bd4c42014ccd82e8277aae7dcc01'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.880941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:31.899024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff35fdef68e147398bc06ef7ebdc2424'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.964519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e93bd4c42014ccd82e8277aae7dcc01'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.972008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e93bd4c42014ccd82e8277aae7dcc01'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.985435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e93bd4c42014ccd82e8277aae7dcc01'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:31.991499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 996/2004] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:31 2022] DELETE /identity/v3/users/6e93bd4c42014ccd82e8277aae7dcc01 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:31.992295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:31.994669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.053391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff35fdef68e147398bc06ef7ebdc2424'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.062516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff35fdef68e147398bc06ef7ebdc2424'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.063567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff35fdef68e147398bc06ef7ebdc2424'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.067221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86997d0d-5bb5-463c-9df7-7402fb8dccd8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.073606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33114f6e-8bf8-45a4-9d77-4f43aa15e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.075231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114f6e-8bf8-45a4-9d77-4f43aa15e1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.075231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114f6e-8bf8-45a4-9d77-4f43aa15e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.075231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114f6e-8bf8-45a4-9d77-4f43aa15e1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.075704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114f6e-8bf8-45a4-9d77-4f43aa15e1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:32.076005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114f6e-8bf8-45a4-9d77-4f43aa15e1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.077683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114f6e-8bf8-45a4-9d77-4f43aa15e1f3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.090805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff35fdef68e147398bc06ef7ebdc2424'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.096383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1009/2005] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:31 2022] DELETE /identity/v3/users/ff35fdef68e147398bc06ef7ebdc2424 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:32.098938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.102792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.103249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 997/2006] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:32.106205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.106496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.106779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.131763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:32.133004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.191969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192c270-0484-432f-829e-6e1ef500e8d4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.196951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.198623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.198903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.199173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.200937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.202939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 998/2007] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:32.203959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.205795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.214568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.216306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.225066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb177-ce16-4a26-81b5-ee238518f871 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.227059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1010/2008] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:32.236131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.236131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.236356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.236356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.236356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.236356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.236647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.236647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.298115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a90249-f9aa-49e1-af81-9f1be2582cf4 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.301827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.302438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.302719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.302995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.316113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.317183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.332307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1011/2009] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:32.341985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.343482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.346944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 999/2010] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:32 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:32.351782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.372551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b5e0c-dd7c-4740-ad0d-6d0638f1eb94 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.427963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:32.455474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.456369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.456658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.456946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] PATH_INFO: `/v3/projects/714fc3bb849f49cfbb622c7ef1f92443` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.458627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=714fc3bb849f49cfbb622c7ef1f92443)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.460803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.476386 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc64c0-dd96-4b93-b171-1ce93d5cece7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.482412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.483320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.484328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.484616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.485574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.488027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.618251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714fc3bb849f49cfbb622c7ef1f92443', 'request_id': 'req-eb9060c1-4501-47b8-bc75-2bbafdace99d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.627696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714fc3bb849f49cfbb622c7ef1f92443', 'request_id': 'req-eb9060c1-4501-47b8-bc75-2bbafdace99d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.632718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1000/2011] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:32 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:32.633648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.634490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714fc3bb849f49cfbb622c7ef1f92443', 'request_id': 'req-eb9060c1-4501-47b8-bc75-2bbafdace99d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.645981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc78b-de98-4a6d-af88-14c91417a9b0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.712040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] The token cache is being invalidate because project 714fc3bb849f49cfbb622c7ef1f92443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:32.712340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.714739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-eb9060c1-4501-47b8-bc75-2bbafdace99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:32.716578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1012/2012] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:32 2022] DELETE /identity/v3/projects/714fc3bb849f49cfbb622c7ef1f92443 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:32.722314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb214-c911-4c94-a7a2-a31ec4dd16c8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.722314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb214-c911-4c94-a7a2-a31ec4dd16c8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.722314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb214-c911-4c94-a7a2-a31ec4dd16c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.725284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.726086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.726520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.726862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.727711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.730401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.747843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1001/2013] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:32.747843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.747843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.757088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8e8cb214-c911-4c94-a7a2-a31ec4dd16c8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:32.758591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8e8cb214-c911-4c94-a7a2-a31ec4dd16c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.762179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355bed0-b136-4e58-b44e-ed13afee51f3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.773427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1013/2014] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:32.773590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.773590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.773590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.773590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.777137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.777137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.777283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903328-340f-4a81-9e0d-7d0ed53a2294 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.777283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903328-340f-4a81-9e0d-7d0ed53a2294 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.777937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24903328-340f-4a81-9e0d-7d0ed53a2294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.784117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1002/2015] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:32.788351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.799714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040511b-95f5-4225-8227-e9edbdf2f75d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.802120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-24903328-340f-4a81-9e0d-7d0ed53a2294 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:32.803301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-24903328-340f-4a81-9e0d-7d0ed53a2294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.804650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.805334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.805588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.805925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] PATH_INFO: `/v3/projects/79a4545d00f544509e5b74c2aaa99331/users/9d17a26e32a04ede923da1f7690885d9/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.811430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1014/2016] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:32.815462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903328-340f-4a81-9e0d-7d0ed53a2294 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.821045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a4545d00f544509e5b74c2aaa99331, user_id=9d17a26e32a04ede923da1f7690885d9, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.824158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.824448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24903328-340f-4a81-9e0d-7d0ed53a2294 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.829437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.830073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.831606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.831606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.831606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:32.831606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.833157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.845453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1015/2017] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:10:32.850665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.862953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3ba83-6e10-4d4b-9499-0a4efdd7598e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:32.867963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e3281-571a-400c-a4f4-faac59845de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:32.868576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3281-571a-400c-a4f4-faac59845de4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.868863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3281-571a-400c-a4f4-faac59845de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.869143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e3281-571a-400c-a4f4-faac59845de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:32.870342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e3281-571a-400c-a4f4-faac59845de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:32.874110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e3281-571a-400c-a4f4-faac59845de4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:32.935109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1003/2018] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:32 2022] PUT /identity/v3/projects/79a4545d00f544509e5b74c2aaa99331/users/9d17a26e32a04ede923da1f7690885d9/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:32.935798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:32.937400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:32.973261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1016/2019] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:32 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:32.975275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f282e5c-7cbb-4142-a224-9db9d740db75 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:32.975976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f282e5c-7cbb-4142-a224-9db9d740db75 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:32.975976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f282e5c-7cbb-4142-a224-9db9d740db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.009127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3f282e5c-7cbb-4142-a224-9db9d740db75 None None] MFA Rules not processed for user `9d17a26e32a04ede923da1f7690885d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:33.011537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3f282e5c-7cbb-4142-a224-9db9d740db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:33.025266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c4c1d-a491-40a4-900a-7a76bf567a9d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.084293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1017/2020] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:33.088853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f282e5c-7cbb-4142-a224-9db9d740db75 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.104934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.105586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.105913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.106195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] PATH_INFO: `/v3/projects/6b727d0add9744639daf28734f07c3d7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.107765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b727d0add9744639daf28734f07c3d7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.109676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.179819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f282e5c-7cbb-4142-a224-9db9d740db75 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.185199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.185866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.186176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.186450 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.187081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.189061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.232046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:33.304636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b727d0add9744639daf28734f07c3d7', 'request_id': 'req-c85a96e4-da7d-4754-ba70-84905002afff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:33.312839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b727d0add9744639daf28734f07c3d7', 'request_id': 'req-c85a96e4-da7d-4754-ba70-84905002afff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:33.320552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b727d0add9744639daf28734f07c3d7', 'request_id': 'req-c85a96e4-da7d-4754-ba70-84905002afff'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:33.346719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1018/2021] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:33 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:33.354808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.359406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b067c-2cc0-4458-a10b-2fce792f3673 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.418640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131fee4-f096-441f-8a3a-1f6638aadb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.419332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131fee4-f096-441f-8a3a-1f6638aadb47 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.419683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131fee4-f096-441f-8a3a-1f6638aadb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.420023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131fee4-f096-441f-8a3a-1f6638aadb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.420714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131fee4-f096-441f-8a3a-1f6638aadb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.422654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131fee4-f096-441f-8a3a-1f6638aadb47 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.458783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] The token cache is being invalidate because project 6b727d0add9744639daf28734f07c3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:33.463690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:33.463690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:33.463690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1004/2022] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:32 2022] DELETE /identity/v3/projects/6b727d0add9744639daf28734f07c3d7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:33.463690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.464285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:33.477045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a96e4-da7d-4754-ba70-84905002afff admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.482146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af8f9b-971c-49e7-9032-025a7294dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.482749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8f9b-971c-49e7-9032-025a7294dffe admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.483029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8f9b-971c-49e7-9032-025a7294dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.483301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af8f9b-971c-49e7-9032-025a7294dffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.483935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8f9b-971c-49e7-9032-025a7294dffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.486341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af8f9b-971c-49e7-9032-025a7294dffe admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.496578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1005/2023] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:33.504109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7cef-f751-4db4-b53a-fc6cee8261e9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.504109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7cef-f751-4db4-b53a-fc6cee8261e9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.504109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e7cef-f751-4db4-b53a-fc6cee8261e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.521105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ba1e7cef-f751-4db4-b53a-fc6cee8261e9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:33.522409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ba1e7cef-f751-4db4-b53a-fc6cee8261e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:33.530551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1006/2024] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:33.531332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e7cef-f751-4db4-b53a-fc6cee8261e9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.540698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e7cef-f751-4db4-b53a-fc6cee8261e9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.545632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.546188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.546489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.546852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.547486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.549061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.559924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1019/2025] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:33 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:33.563139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1007/2026] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:33.563723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.565365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:33.567094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a3f0-54ef-4194-a4aa-0cac51a17394 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.567402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a3f0-54ef-4194-a4aa-0cac51a17394 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.567681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415a3f0-54ef-4194-a4aa-0cac51a17394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.579476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af16309-9189-4c32-b110-d1d156dc7345 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.590920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9415a3f0-54ef-4194-a4aa-0cac51a17394 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:33.592175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9415a3f0-54ef-4194-a4aa-0cac51a17394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:33.638599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.639364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.639740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.640110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.640848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.642917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.656180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1020/2027] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:33.657014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415a3f0-54ef-4194-a4aa-0cac51a17394 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.666137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415a3f0-54ef-4194-a4aa-0cac51a17394 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.670854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.671493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.671777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.672058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] PATH_INFO: `/v3/projects/b12c605fd9844936ba9abf115ba753db/users/a8e8dd3db526404ebdd61b4fa8e92d92/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.686882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12c605fd9844936ba9abf115ba753db, user_id=a8e8dd3db526404ebdd61b4fa8e92d92, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.690078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.769115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1021/2028] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:33 2022] PUT /identity/v3/projects/b12c605fd9844936ba9abf115ba753db/users/a8e8dd3db526404ebdd61b4fa8e92d92/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:33.775476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1008/2029] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:33 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:33.775725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.775843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.783750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72c316-6101-4ba1-8bb9-055a25c7f80f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.821094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:33.836063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d63d23-07ce-4784-bcbd-659ca39194b3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.841801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d63ce-94d3-41ae-8b97-7659266ad16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.842425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d63ce-94d3-41ae-8b97-7659266ad16c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.842709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d63ce-94d3-41ae-8b97-7659266ad16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.843042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d63ce-94d3-41ae-8b97-7659266ad16c admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.844087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d63ce-94d3-41ae-8b97-7659266ad16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:33.844087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d63ce-94d3-41ae-8b97-7659266ad16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.845519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d63ce-94d3-41ae-8b97-7659266ad16c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.853313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.854828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.855238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.855597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.856707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.858634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.860346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1022/2030] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:33.861615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11410c60-6b58-419a-ab8d-e09bc7763144 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.861938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11410c60-6b58-419a-ab8d-e09bc7763144 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.862498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11410c60-6b58-419a-ab8d-e09bc7763144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.873456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1009/2031] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:33.875312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.887018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a69326-5f4b-4938-9e4d-1b204bdba2c2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.887235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-11410c60-6b58-419a-ab8d-e09bc7763144 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:33.888527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-11410c60-6b58-419a-ab8d-e09bc7763144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:33.892748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.893464 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.893915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.894264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.894960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.896908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1023/2032] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:33.897068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.897674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11410c60-6b58-419a-ab8d-e09bc7763144 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.909604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11410c60-6b58-419a-ab8d-e09bc7763144 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.915104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:33.915759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:33.916986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:33.917258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:33.917949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:33.919595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:33.929647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1024/2033] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:33.930543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:33.932690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:33.991996 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd87ae-edec-49be-82a8-d680410da7c1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:33.993383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1010/2034] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:33 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:33.994117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.048044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.048758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.049077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.049383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.060209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.061742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.062050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db69dc1-c4e9-4e9e-806d-23f87477ed6f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.067057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.067769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.068117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.068334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] PATH_INFO: `/v3/projects/9d8bbb0553d246b2a5bf5e7347e1edbf/users/0d9a58196d5d4d8ea382d7b35d9a195a/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.073096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1025/2035] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:34.074165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.085807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116cfce-7d3e-4b2c-9a44-fac4a345bb53 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.092883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8bbb0553d246b2a5bf5e7347e1edbf, user_id=0d9a58196d5d4d8ea382d7b35d9a195a, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.096065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.097867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33747797-a7ff-478c-a66d-36b2ff1dbaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.098540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747797-a7ff-478c-a66d-36b2ff1dbaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.105359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747797-a7ff-478c-a66d-36b2ff1dbaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.105359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747797-a7ff-478c-a66d-36b2ff1dbaa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.105359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33747797-a7ff-478c-a66d-36b2ff1dbaa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.105359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33747797-a7ff-478c-a66d-36b2ff1dbaa4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.127967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:34.277966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:34.280901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1011/2036] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:33 2022] PUT /identity/v3/projects/9d8bbb0553d246b2a5bf5e7347e1edbf/users/0d9a58196d5d4d8ea382d7b35d9a195a/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:34.286989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1026/2037] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:34 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:34.288335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.292778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2c90-de2c-4afb-8d18-19e4ed9fd1df None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.293071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2c90-de2c-4afb-8d18-19e4ed9fd1df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.293353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c2c90-de2c-4afb-8d18-19e4ed9fd1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.327291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d50c2c90-de2c-4afb-8d18-19e4ed9fd1df None None] MFA Rules not processed for user `0d9a58196d5d4d8ea382d7b35d9a195a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:34.328569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d50c2c90-de2c-4afb-8d18-19e4ed9fd1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:34.363163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f77730-8f3d-4ce5-b178-798d54a6293a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.368797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.382899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.382899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.382899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.382899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.382899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.401898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1012/2038] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:34.405704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.420167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b62a-3eca-46ac-80b1-4678009d91c5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.439637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.440329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.440616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.440895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.441678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.443627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.464930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1013/2039] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:34.468238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1027/2040] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:34.469317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.472322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c2c90-de2c-4afb-8d18-19e4ed9fd1df None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.486195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc68d-6810-4101-bf9e-ad3819870693 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.491542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed2f85-f812-497c-896b-b3a83c9523ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.491830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c2c90-de2c-4afb-8d18-19e4ed9fd1df None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.492299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2f85-f812-497c-896b-b3a83c9523ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.492687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2f85-f812-497c-896b-b3a83c9523ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.492982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed2f85-f812-497c-896b-b3a83c9523ca admin admin] PATH_INFO: `/v3/projects/5c278606615e4cc78a77fbdb41e47977/users/7eaa6c2e46e6412599b2744a015b1f12/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.497647 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.498506 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.498696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.498990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.499625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.501572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.509902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2f85-f812-497c-896b-b3a83c9523ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c278606615e4cc78a77fbdb41e47977, user_id=7eaa6c2e46e6412599b2744a015b1f12, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.512771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed2f85-f812-497c-896b-b3a83c9523ca admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.626574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1014/2041] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:34 2022] PUT /identity/v3/projects/5c278606615e4cc78a77fbdb41e47977/users/7eaa6c2e46e6412599b2744a015b1f12/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:34.636651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e2142-f6ba-40c8-836a-7fc82b3a14cf None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.636943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e2142-f6ba-40c8-836a-7fc82b3a14cf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.637220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e2142-f6ba-40c8-836a-7fc82b3a14cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.651143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1028/2042] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:34 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:34.655448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.657752 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:34.676580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-319e2142-f6ba-40c8-836a-7fc82b3a14cf None None] MFA Rules not processed for user `7eaa6c2e46e6412599b2744a015b1f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:34.677844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-319e2142-f6ba-40c8-836a-7fc82b3a14cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:34.753870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffea26-5f23-4d0d-b2f0-030bd5a0d21f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.760070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.760519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.760801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.761186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] PATH_INFO: `/v3/users/a3e6836ce5cd42a7b1868694a3af8f5f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.762532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e6836ce5cd42a7b1868694a3af8f5f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.762641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1015/2043] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:34.764386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.764919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e2142-f6ba-40c8-836a-7fc82b3a14cf None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.777339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e2142-f6ba-40c8-836a-7fc82b3a14cf None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.784805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.785430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.785866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.786158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.786782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:34.788718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:34.912185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1016/2044] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:34 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:34.913906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:34.915954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:34.939682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:34.982567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1254-6853-4520-948d-dc994d2bdd5f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:34.986709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:34.987343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:34.987746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:34.987928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:34.998626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:35.000065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:35.010668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1017/2045] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:35.011529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:35.022172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fab677-bcf5-4d52-9048-703a2c4afbb0 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:35.029359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:35.030699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.031081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.031367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.032013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:35.034160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:35.034836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e6836ce5cd42a7b1868694a3af8f5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:35.058146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1018/2046] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:35.059454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:35.070295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f7c52-b746-47c8-bcc1-e5cd605ac030 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:35.076336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:35.077100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.078004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.078396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] PATH_INFO: `/v3/projects/6294215c6aed4fb58e7822ecf80acbc5/users/ae48d5b91ab9451aaf1b1653ce26ffc4/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.100984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6294215c6aed4fb58e7822ecf80acbc5, user_id=ae48d5b91ab9451aaf1b1653ce26ffc4, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:35.104226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:35.128573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e6836ce5cd42a7b1868694a3af8f5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:35.139893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e6836ce5cd42a7b1868694a3af8f5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:35.141130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e6836ce5cd42a7b1868694a3af8f5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:35.155031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-524a6f10-22dd-408e-a343-2734a149f93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e6836ce5cd42a7b1868694a3af8f5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:35.161251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1029/2047] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:34 2022] DELETE /identity/v3/users/a3e6836ce5cd42a7b1868694a3af8f5f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:35.165828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.166308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.166884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.180440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1019/2048] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:35 2022] PUT /identity/v3/projects/6294215c6aed4fb58e7822ecf80acbc5/users/ae48d5b91ab9451aaf1b1653ce26ffc4/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:35.185722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:35.187125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:35.187247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:35.188812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:35.257910 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1030/2049] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:35.266994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:35.268831 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:35.273224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36d5a0-dc01-4d42-8369-8474f61a6d0a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:35.282294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:35.283909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.284456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.285515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.286494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:35.290371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:35.305914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1020/2050] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:35.310666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:35.326662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73836bb4-be03-4d15-a166-4793e02454c3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:35.332593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d769b0-1130-4a5d-a207-76e0484a6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:35.332593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d769b0-1130-4a5d-a207-76e0484a6d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.332593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d769b0-1130-4a5d-a207-76e0484a6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.332936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d769b0-1130-4a5d-a207-76e0484a6d7f admin admin] PATH_INFO: `/v3/projects/6294215c6aed4fb58e7822ecf80acbc5/users/ae48d5b91ab9451aaf1b1653ce26ffc4/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.334791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d769b0-1130-4a5d-a207-76e0484a6d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6294215c6aed4fb58e7822ecf80acbc5, user_id=ae48d5b91ab9451aaf1b1653ce26ffc4, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:35.337446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d769b0-1130-4a5d-a207-76e0484a6d7f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:35.348688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99973af-2ceb-4a4a-8ab2-335316a30a7c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:35.355079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1021/2051] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:35 2022] PUT /identity/v3/projects/6294215c6aed4fb58e7822ecf80acbc5/users/ae48d5b91ab9451aaf1b1653ce26ffc4/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:35.364793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.365324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.365613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.402424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] MFA Rules not processed for user `ae48d5b91ab9451aaf1b1653ce26ffc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:35.404176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:35.423296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:35.424104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.424394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.424677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.503764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1022/2052] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:35.517241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:35.519021 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:35.546332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1031/2053] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:35.546424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:35.546424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:35.596662 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:35.640126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7f5a-b8ed-41d1-9bbb-2c7f859762f5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:35.645205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:35.646031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:35.646466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:35.646796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:35.648941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:35.731467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:35.733640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:35.746513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1023/2054] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:36.098493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:36.100326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:36.116738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b096b54-81c9-499f-ab23-af16893580b5 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:36.123472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:36.124363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:36.124648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:36.124929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] PATH_INFO: `/v3/projects/1783b03cf47d4fd7a98d21bdcce47357` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:36.129824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1783b03cf47d4fd7a98d21bdcce47357)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:36.129824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:36.324163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1783b03cf47d4fd7a98d21bdcce47357', 'request_id': 'req-aeed8c90-242b-41f4-8c0c-59f93ad65801'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:36.338380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1783b03cf47d4fd7a98d21bdcce47357', 'request_id': 'req-aeed8c90-242b-41f4-8c0c-59f93ad65801'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:36.345623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1783b03cf47d4fd7a98d21bdcce47357', 'request_id': 'req-aeed8c90-242b-41f4-8c0c-59f93ad65801'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:36.442381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] The token cache is being invalidate because project 1783b03cf47d4fd7a98d21bdcce47357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:36.442823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:36.446026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:36.448970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1032/2055] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:36 2022] DELETE /identity/v3/projects/1783b03cf47d4fd7a98d21bdcce47357 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:36.455645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:36.469056 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da63eb-fbac-42fd-9c24-dbf4dcc8d6ba service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:36.570952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:36.571692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:36.572037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:36.573593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] PATH_INFO: `/v3/users/e273c30aeabb412989f0de8624d01a98` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:36.575088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e273c30aeabb412989f0de8624d01a98)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:36.577201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:36.604197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:36.935252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e273c30aeabb412989f0de8624d01a98'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:36.935947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e273c30aeabb412989f0de8624d01a98'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:37.035272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e273c30aeabb412989f0de8624d01a98'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:37.046285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e273c30aeabb412989f0de8624d01a98'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:37.065321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-828535aa-dd33-4d9c-844b-8d2372b55cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e273c30aeabb412989f0de8624d01a98'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:37.075961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1024/2056] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:36 2022] DELETE /identity/v3/users/e273c30aeabb412989f0de8624d01a98 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:37.340391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:37.591457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:37.595515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:37.632376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed8c90-242b-41f4-8c0c-59f93ad65801 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:37.770478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:37.772460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:37.772969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:37.774086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] PATH_INFO: `/v3/projects/5c4ce71b5a674fa59e85799b39ea7894` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:37.775782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4ce71b5a674fa59e85799b39ea7894)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:37.779354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:37.928584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4ce71b5a674fa59e85799b39ea7894', 'request_id': 'req-4f3bd380-d3a6-4549-9ebb-429685aa2785'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:37.942597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4ce71b5a674fa59e85799b39ea7894', 'request_id': 'req-4f3bd380-d3a6-4549-9ebb-429685aa2785'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:37.951420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4ce71b5a674fa59e85799b39ea7894', 'request_id': 'req-4f3bd380-d3a6-4549-9ebb-429685aa2785'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:38.069686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] The token cache is being invalidate because project 5c4ce71b5a674fa59e85799b39ea7894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:38.070040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:38.070779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:38.072483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1033/2057] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:37 2022] DELETE /identity/v3/projects/5c4ce71b5a674fa59e85799b39ea7894 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:38.078136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1c4e-8e7e-450e-bb42-ba28f61d962c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.078620 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1c4e-8e7e-450e-bb42-ba28f61d962c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.078876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1c4e-8e7e-450e-bb42-ba28f61d962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.118129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5d8f1c4e-8e7e-450e-bb42-ba28f61d962c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:38.122019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5d8f1c4e-8e7e-450e-bb42-ba28f61d962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:38.144370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:38.144370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:38.261335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1025/2058] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:38.262827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3abad9-713a-47e3-b413-bd5d2394bab1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.264311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3abad9-713a-47e3-b413-bd5d2394bab1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.264311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3abad9-713a-47e3-b413-bd5d2394bab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.270523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bd380-d3a6-4549-9ebb-429685aa2785 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:38.272449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:38.273133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.273354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.273886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.282446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:38.285942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7f3abad9-713a-47e3-b413-bd5d2394bab1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:38.287326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7f3abad9-713a-47e3-b413-bd5d2394bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:38.300890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1026/2059] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:38.302118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3abad9-713a-47e3-b413-bd5d2394bab1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:38.312281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3abad9-713a-47e3-b413-bd5d2394bab1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:38.317796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:38.318638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.318912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.319174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.319842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:38.320152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:38.321868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:38.335494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1027/2060] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:38.342057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:38.353257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ab048-d848-498a-9367-d5236a5114e0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:38.359783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:38.360403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.360691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.360970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.361787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:38.363994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:38.389917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:38.391364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:38.408932 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1034/2061] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:38.472344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1028/2062] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:38 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:38.473828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:38.485696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a0b82-9853-4119-8de6-1392830dd41d service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:38.557627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:38.558477 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.558761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.559036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.559817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:38.561832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:38.667822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1035/2063] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:38 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:38.672030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:38.683396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aac035-0804-4473-9b83-a6efd0aa0d39 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:38.690805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:38.691529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.691885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.692230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.693136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:38.695467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:38.699320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:38.709391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1029/2064] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:38.718237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:38.749130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de84e76-dffd-435b-849e-297d469eaedd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:38.749130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78beb7e6-6249-48dc-802c-c7f9961a9b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:38.749130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beb7e6-6249-48dc-802c-c7f9961a9b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.749130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beb7e6-6249-48dc-802c-c7f9961a9b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.749499 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78beb7e6-6249-48dc-802c-c7f9961a9b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.750067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beb7e6-6249-48dc-802c-c7f9961a9b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:38.751689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78beb7e6-6249-48dc-802c-c7f9961a9b74 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:38.762665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1036/2065] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:38.767191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:38.782996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8c699-77f2-4106-8735-5d54b51e96dc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:38.788479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:38.789869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.789869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.789869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] PATH_INFO: `/v3/projects/55889c6093914a49ac7539713f6e8f6c/users/6411a929a0a94ca4b44a5f123fc2c1ff/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.807484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55889c6093914a49ac7539713f6e8f6c, user_id=6411a929a0a94ca4b44a5f123fc2c1ff, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:38.811094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:38.937601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1030/2066] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:38 2022] PUT /identity/v3/projects/55889c6093914a49ac7539713f6e8f6c/users/6411a929a0a94ca4b44a5f123fc2c1ff/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:38.948902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e66c8-2eb3-435b-ae99-22bcdaef0637 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:38.949195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e66c8-2eb3-435b-ae99-22bcdaef0637 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:38.949583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e66c8-2eb3-435b-ae99-22bcdaef0637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:38.985899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b27e66c8-2eb3-435b-ae99-22bcdaef0637 None None] MFA Rules not processed for user `6411a929a0a94ca4b44a5f123fc2c1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:38.987576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b27e66c8-2eb3-435b-ae99-22bcdaef0637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:39.071362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1037/2067] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:39.076508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:39.172168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6c867-4de1-49a6-b657-6479d983e25b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:39.187766 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:39.188590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:39.188965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:39.189307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:39.190284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:39.192255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:39.373736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e66c8-2eb3-435b-ae99-22bcdaef0637 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:39.374135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1031/2068] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:39 2022] POST /identity/v3/projects => generated 387 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:39.387978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e66c8-2eb3-435b-ae99-22bcdaef0637 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:39.475620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:39.476469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:39.477310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:39.477650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:39.482615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:39.483984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:39.486177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:39.593221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1038/2069] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:39 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:39.596868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:39.609197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6b497-411a-49f6-9c85-512d8923e3b9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:39.614958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:39.615593 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:39.615890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:39.616146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:39.616814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:39.624425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:39.642347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:39.651659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1032/2070] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:39.655305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec6555-daf6-4c92-bd02-c558e96c5a59 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:39.676050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:39.676738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:39.677023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:39.677293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] PATH_INFO: `/v3/projects/2cc597a7bce54bff97ed91bdfcb45d3e/users/35610b46eea8442a9118cece5cddc639/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:39.685225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:39.687555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:39.697648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc597a7bce54bff97ed91bdfcb45d3e, user_id=35610b46eea8442a9118cece5cddc639, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:39.702641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:39.704873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06a2e2-d113-41da-88f8-60c49f35336d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:39.711335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:39.711610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:39.714873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:39.714873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] PATH_INFO: `/v3/users/7eaa6c2e46e6412599b2744a015b1f12` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:39.714873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eaa6c2e46e6412599b2744a015b1f12)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:39.716476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:39.797969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1039/2071] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:39 2022] PUT /identity/v3/projects/2cc597a7bce54bff97ed91bdfcb45d3e/users/35610b46eea8442a9118cece5cddc639/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:39.802027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:39.904881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b005ca-3686-4bbf-8934-91e7ae8944d3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:39.914963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:39.915704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:39.916256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:39.917479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:39.918604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:39.920875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:39.935005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1040/2072] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:39.940022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:39.986902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eaa6c2e46e6412599b2744a015b1f12'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:39.987949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eaa6c2e46e6412599b2744a015b1f12'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:39.998777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f2fee-4e9d-438c-9746-7d6b9d813b34 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:40.013805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6dd6b-e5fc-4193-baea-66d11b247eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:40.015078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6dd6b-e5fc-4193-baea-66d11b247eff admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:40.015546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6dd6b-e5fc-4193-baea-66d11b247eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:40.016380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6dd6b-e5fc-4193-baea-66d11b247eff admin admin] PATH_INFO: `/v3/projects/2cc597a7bce54bff97ed91bdfcb45d3e/users/35610b46eea8442a9118cece5cddc639/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:40.018953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6dd6b-e5fc-4193-baea-66d11b247eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc597a7bce54bff97ed91bdfcb45d3e, user_id=35610b46eea8442a9118cece5cddc639, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:40.025857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6dd6b-e5fc-4193-baea-66d11b247eff admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:40.041832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1041/2073] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:39 2022] PUT /identity/v3/projects/2cc597a7bce54bff97ed91bdfcb45d3e/users/35610b46eea8442a9118cece5cddc639/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:40.053294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:40.053670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:40.054067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:40.060990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eaa6c2e46e6412599b2744a015b1f12'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:40.076481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eaa6c2e46e6412599b2744a015b1f12'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:40.093976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd3e9dec-ac99-4a4f-bd1a-dbf4c2d43381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eaa6c2e46e6412599b2744a015b1f12'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:40.094710 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] MFA Rules not processed for user `35610b46eea8442a9118cece5cddc639`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:40.095913 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:40.102319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1033/2074] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:39 2022] DELETE /identity/v3/users/7eaa6c2e46e6412599b2744a015b1f12 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:40.111952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:40.111952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:40.111952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:40.137482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:40.139079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:40.208335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1042/2075] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:40.209670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:40.211163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:40.242560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1034/2076] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:40.256786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:40.258992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:40.305977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf7d7-6ddd-4208-a563-3027cc669641 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:40.351625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f68dd-f9eb-4dc8-9217-1af82ee2cc12 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:40.357038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:40.357806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:40.358202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:40.358570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:40.371132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:40.373200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:40.391430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:40.392071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:40.392369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:40.392648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:40.393488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1035/2077] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:40.398346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:40.399790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:40.418813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed864f2-0d26-4f4b-9d2f-2adbdf59b7e5 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:40.428360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56482b-242a-4ace-b16f-8163e6c490c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:40.430390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56482b-242a-4ace-b16f-8163e6c490c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:40.430917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56482b-242a-4ace-b16f-8163e6c490c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:40.431434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56482b-242a-4ace-b16f-8163e6c490c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:40.435875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ca56482b-242a-4ace-b16f-8163e6c490c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:40.486819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:40.488809 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:40.501731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:40.513494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1043/2078] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:40.525494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56482b-242a-4ace-b16f-8163e6c490c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:40.527221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56482b-242a-4ace-b16f-8163e6c490c2 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:40.538760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1036/2079] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:40.559074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:41.397789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:41.400175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:41.421045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe530d5-3edd-45ef-a8b4-e840487d7cce service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:41.452405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:41.459663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:41.459663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:41.459663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] PATH_INFO: `/v3/projects/5c278606615e4cc78a77fbdb41e47977` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:41.459663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c278606615e4cc78a77fbdb41e47977)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:41.462264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:41.531872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:41.532905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:41.533238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:41.577237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:41.578981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] MFA Rules not processed for user `a8e8dd3db526404ebdd61b4fa8e92d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:41.580388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:41.606514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c278606615e4cc78a77fbdb41e47977', 'request_id': 'req-dd54e3f2-70b6-42de-a085-723911da76c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:41.613069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c278606615e4cc78a77fbdb41e47977', 'request_id': 'req-dd54e3f2-70b6-42de-a085-723911da76c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:41.622127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c278606615e4cc78a77fbdb41e47977', 'request_id': 'req-dd54e3f2-70b6-42de-a085-723911da76c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:41.703434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1037/2080] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:41.707332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] The token cache is being invalidate because project 5c278606615e4cc78a77fbdb41e47977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:41.707746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:41.708923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-dd54e3f2-70b6-42de-a085-723911da76c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:41.710698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:41.710818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1044/2081] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:41 2022] DELETE /identity/v3/projects/5c278606615e4cc78a77fbdb41e47977 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:41.714438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:41.721525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027c5d-bc7a-4cf0-82ea-ff7585c5c7a0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:41.726619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027c5d-bc7a-4cf0-82ea-ff7585c5c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:41.726619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027c5d-bc7a-4cf0-82ea-ff7585c5c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:41.755512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-99027c5d-bc7a-4cf0-82ea-ff7585c5c7a0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:41.757602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-99027c5d-bc7a-4cf0-82ea-ff7585c5c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:41.835659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeef36-48c1-4ffc-85f4-0b136b51f3ed None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:41.855221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:41.859407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1045/2082] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:41.860461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:41.860827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:41.861173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:41.870148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f6c8-0ea8-4dde-9599-5255b38d4423 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:41.870462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f6c8-0ea8-4dde-9599-5255b38d4423 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:41.870725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7f6c8-0ea8-4dde-9599-5255b38d4423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:41.872061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:41.886323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:41.888010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:41.896547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d9b7f6c8-0ea8-4dde-9599-5255b38d4423 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:41.897847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d9b7f6c8-0ea8-4dde-9599-5255b38d4423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:41.898608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1038/2083] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:41.911950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1046/2084] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:41.912732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:41.933066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b101-9563-45ef-9431-9fbc6315bded service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:41.940670 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:41.941633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:41.941633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:41.941928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:41.943288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:41.943603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:41.945218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:41.951428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:41.968002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1039/2085] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:10:41.971463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7f6c8-0ea8-4dde-9599-5255b38d4423 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:41.982336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7f6c8-0ea8-4dde-9599-5255b38d4423 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:41.990458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:41.991089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:41.991517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:41.991716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:41.992743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:41.998204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.108421 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1047/2086] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:41 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:42.109467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.121877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f82a8-c113-4035-b7ef-fba9c210add2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:42.198288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:42.205983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:42.205983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.205983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.205983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.206538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:42.207283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.282450 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.284190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:42.304749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1040/2087] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:42 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:42.305262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7ecb1-23e5-4a8b-a5a0-db35a10706d7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:42.313696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.318262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:42.319140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.321859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.326276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] PATH_INFO: `/v3/users/6411a929a0a94ca4b44a5f123fc2c1ff` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.332121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feba3f-b8a0-4597-9b1a-fa87602d8486 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:42.339439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:42.339661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6411a929a0a94ca4b44a5f123fc2c1ff)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:42.340226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.340586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.340932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.341490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.341735 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:42.344039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.366112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1041/2088] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:42.370933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.383220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7da14-e40f-46a0-a3b3-1770fda4b79c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:42.388584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:42.389209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.389488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.389788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.390439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:42.392030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.403782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1042/2089] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:42.410185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.419818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781b0f8-ace9-47bc-ad25-52a4a5704353 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:42.426556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf24a4-d7de-4a3d-a27c-25fdd5f85f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:42.427238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf24a4-d7de-4a3d-a27c-25fdd5f85f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.427683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf24a4-d7de-4a3d-a27c-25fdd5f85f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.427971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf24a4-d7de-4a3d-a27c-25fdd5f85f86 admin admin] PATH_INFO: `/v3/projects/955f4af9c40c4dad971b6c2150d4dffc/users/42ea05bd67f44dda9111d2d49745d7e0/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.445009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf24a4-d7de-4a3d-a27c-25fdd5f85f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955f4af9c40c4dad971b6c2150d4dffc, user_id=42ea05bd67f44dda9111d2d49745d7e0, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:42.447863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf24a4-d7de-4a3d-a27c-25fdd5f85f86 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.522889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1043/2090] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:42 2022] PUT /identity/v3/projects/955f4af9c40c4dad971b6c2150d4dffc/users/42ea05bd67f44dda9111d2d49745d7e0/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:42.533586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539d00-d94f-4a33-8760-c54b05ed76c0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.534576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539d00-d94f-4a33-8760-c54b05ed76c0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.535076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539d00-d94f-4a33-8760-c54b05ed76c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.550615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6411a929a0a94ca4b44a5f123fc2c1ff'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:42.575647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-be539d00-d94f-4a33-8760-c54b05ed76c0 None None] MFA Rules not processed for user `42ea05bd67f44dda9111d2d49745d7e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:42.576865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-be539d00-d94f-4a33-8760-c54b05ed76c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:42.632702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6411a929a0a94ca4b44a5f123fc2c1ff'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:42.645100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6411a929a0a94ca4b44a5f123fc2c1ff'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:42.648801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6411a929a0a94ca4b44a5f123fc2c1ff'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:42.663542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1044/2091] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:42.674852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539d00-d94f-4a33-8760-c54b05ed76c0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.683185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9776b988-5717-4a8e-abaf-2dd1d97f1e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6411a929a0a94ca4b44a5f123fc2c1ff'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:42.695585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1048/2092] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:42 2022] DELETE /identity/v3/users/6411a929a0a94ca4b44a5f123fc2c1ff => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:42.701059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.701351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.701634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.724299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:42.725934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:42.757180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539d00-d94f-4a33-8760-c54b05ed76c0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:42.803478 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1049/2093] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:42.813939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.815353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:42.818371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:42.818985 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.819271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.819550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.820190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:42.822732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.901126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcba3e-09da-4afa-b426-88ad680b1538 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:42.905149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:42.905884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:42.906230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:42.906681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:42.919761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:42.921233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:42.938006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1050/2094] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:42.947791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1045/2095] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:42 2022] POST /identity/v3/projects => generated 375 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:42.951245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:42.952700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:42.966706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74427c-3bf2-4fcc-bb77-34fbe688a18b service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:43.038177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:43.038722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:43.039003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:43.039481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:43.040123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:43.042600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:43.048886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:43.156917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1051/2096] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:42 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:43.160932 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:43.176752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729165b-0bf3-4379-9481-78c2fd25b5ea admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:43.178772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:43.179437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:43.179726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:43.180001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:43.180648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:43.182951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:43.200356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1046/2097] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:43.201598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:43.215357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11115a4-6986-4409-a54c-669223e79c67 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:43.220876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010b79-b0c3-419a-bf1e-872c9620740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:43.223317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010b79-b0c3-419a-bf1e-872c9620740a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:43.223317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010b79-b0c3-419a-bf1e-872c9620740a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:43.223317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010b79-b0c3-419a-bf1e-872c9620740a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:43.223793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010b79-b0c3-419a-bf1e-872c9620740a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:43.226052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5010b79-b0c3-419a-bf1e-872c9620740a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:43.240281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1052/2098] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:43.242333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:43.256759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468a4d5-754a-4106-b684-3587f4a7ac74 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:43.264179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:43.264864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:43.265197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:43.265479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] PATH_INFO: `/v3/projects/b66fda915e2c44109863ab685452e533/users/19874af4c80b4a569f2dd7925f45a2cc/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:43.284049 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66fda915e2c44109863ab685452e533, user_id=19874af4c80b4a569f2dd7925f45a2cc, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:43.287596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:43.429151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1047/2099] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:43 2022] PUT /identity/v3/projects/b66fda915e2c44109863ab685452e533/users/19874af4c80b4a569f2dd7925f45a2cc/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:43.440473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272bf9-5ad9-4c33-8a15-23c71d082331 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:43.440761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272bf9-5ad9-4c33-8a15-23c71d082331 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:43.441042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc272bf9-5ad9-4c33-8a15-23c71d082331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:43.473783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:43.476019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:43.546741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bc272bf9-5ad9-4c33-8a15-23c71d082331 None None] MFA Rules not processed for user `19874af4c80b4a569f2dd7925f45a2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:43.549859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:43.551998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bc272bf9-5ad9-4c33-8a15-23c71d082331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:43.691375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1884f-8661-4e82-bae0-94d98f7df92c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:43.701883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1053/2100] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:43.706420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272bf9-5ad9-4c33-8a15-23c71d082331 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:43.717613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:43.718314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:43.718607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:43.718874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] PATH_INFO: `/v3/projects/55889c6093914a49ac7539713f6e8f6c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:43.720187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55889c6093914a49ac7539713f6e8f6c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:43.722414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:43.726148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc272bf9-5ad9-4c33-8a15-23c71d082331 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:43.732021 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:43.732702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:43.732982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:43.733256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:43.733989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:43.736488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:43.779225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:43.852024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1054/2101] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:43 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:43.856254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:43.944949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55889c6093914a49ac7539713f6e8f6c', 'request_id': 'req-fe574331-97ca-4f55-9376-7ff0b632f22a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:43.947899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02912c1b-bbb9-422b-a15e-5a79967e1b71 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:43.956845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55889c6093914a49ac7539713f6e8f6c', 'request_id': 'req-fe574331-97ca-4f55-9376-7ff0b632f22a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:43.971361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55889c6093914a49ac7539713f6e8f6c', 'request_id': 'req-fe574331-97ca-4f55-9376-7ff0b632f22a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.068358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] The token cache is being invalidate because project 55889c6093914a49ac7539713f6e8f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:44.068358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.069038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.070396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1048/2102] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:43 2022] DELETE /identity/v3/projects/55889c6093914a49ac7539713f6e8f6c => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:44.076694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:44.080267 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:44.083154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:44.083888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.084277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.084776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.085483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:44.087554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:44.105941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe574331-97ca-4f55-9376-7ff0b632f22a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:44.111229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:44.111868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.112145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.112418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] PATH_INFO: `/v3/users/35610b46eea8442a9118cece5cddc639` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.113563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35610b46eea8442a9118cece5cddc639)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:44.115565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:44.219175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1055/2103] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:43 2022] POST /identity/v3/users => generated 295 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:44.221218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:44.223929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:44.242814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23a592-806e-4d0b-8f00-ffe4e0586143 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:44.250074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:44.250774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.251386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.251386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.252308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:44.253969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:44.269166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1056/2104] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:44.270609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:44.282405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f03c2-9bb1-42b1-bbba-c79b4210c372 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:44.289473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:44.290239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.290526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.291476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] PATH_INFO: `/v3/projects/10deca7e670c4bbcb40d81d9d230914b/users/e0dc663c4ad644efa99b7ef1d384ea1b/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.319535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10deca7e670c4bbcb40d81d9d230914b, user_id=e0dc663c4ad644efa99b7ef1d384ea1b, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:44.322262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:44.360468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35610b46eea8442a9118cece5cddc639'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.361169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35610b46eea8442a9118cece5cddc639'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.419406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1057/2105] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:44 2022] PUT /identity/v3/projects/10deca7e670c4bbcb40d81d9d230914b/users/e0dc663c4ad644efa99b7ef1d384ea1b/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:44.421199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:44.438467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35610b46eea8442a9118cece5cddc639'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.446812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35610b46eea8442a9118cece5cddc639'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.462861 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35610b46eea8442a9118cece5cddc639'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:44.475444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1049/2106] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:44 2022] DELETE /identity/v3/users/35610b46eea8442a9118cece5cddc639 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:44.539299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15dd03e-dbca-4341-b47c-cda5b34f9aa5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:44.637404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfa2be-e211-4031-b528-ddc47c8cab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:44.638084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa2be-e211-4031-b528-ddc47c8cab24 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.639234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa2be-e211-4031-b528-ddc47c8cab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.639543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa2be-e211-4031-b528-ddc47c8cab24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.640313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfa2be-e211-4031-b528-ddc47c8cab24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:44.642548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfa2be-e211-4031-b528-ddc47c8cab24 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:44.654894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1058/2107] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:44.659294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:44.660714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:44.675607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dadd25-9bd9-4c56-9b10-6345d3b44d70 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:44.680608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53e240-99f0-4184-a203-378043f1410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:44.681530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53e240-99f0-4184-a203-378043f1410f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.681869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53e240-99f0-4184-a203-378043f1410f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.682223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53e240-99f0-4184-a203-378043f1410f admin admin] PATH_INFO: `/v3/projects/10deca7e670c4bbcb40d81d9d230914b/users/e0dc663c4ad644efa99b7ef1d384ea1b/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.684286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53e240-99f0-4184-a203-378043f1410f admin admin] RBAC: Authorizing `identity:create_grant(project_id=10deca7e670c4bbcb40d81d9d230914b, user_id=e0dc663c4ad644efa99b7ef1d384ea1b, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:44.687021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53e240-99f0-4184-a203-378043f1410f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:44.708009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1050/2108] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:44 2022] PUT /identity/v3/projects/10deca7e670c4bbcb40d81d9d230914b/users/e0dc663c4ad644efa99b7ef1d384ea1b/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:44.709893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.710274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.710472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.760332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] MFA Rules not processed for user `e0dc663c4ad644efa99b7ef1d384ea1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:44.762104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:44.855762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:44.856260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:44.856689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:44.896509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] MFA Rules not processed for user `a8e8dd3db526404ebdd61b4fa8e92d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:44.897740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:44.910560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1059/2109] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:44.932375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:44.934896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:45.005656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1051/2110] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:45.031427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6f4e2-a1bd-49ee-938f-819f42764cc5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:45.035201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd689892-3b21-4886-8d90-c1a790842cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:45.035816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689892-3b21-4886-8d90-c1a790842cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:45.036099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689892-3b21-4886-8d90-c1a790842cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:45.036371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689892-3b21-4886-8d90-c1a790842cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:45.045227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd689892-3b21-4886-8d90-c1a790842cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:45.076013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:45.078931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:45.149912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd689892-3b21-4886-8d90-c1a790842cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:45.155140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd689892-3b21-4886-8d90-c1a790842cf3 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:45.170776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1060/2111] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:45.194808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf535013-155f-4204-8ce9-3f1f36c47aea None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:45.203290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:45.204149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:45.207897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:45.207897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] PATH_INFO: `/v3/projects/2cc597a7bce54bff97ed91bdfcb45d3e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:45.207897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc597a7bce54bff97ed91bdfcb45d3e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:45.210152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:45.397616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc597a7bce54bff97ed91bdfcb45d3e', 'request_id': 'req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:45.412503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc597a7bce54bff97ed91bdfcb45d3e', 'request_id': 'req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:45.421172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc597a7bce54bff97ed91bdfcb45d3e', 'request_id': 'req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:45.511048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:45.520186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] The token cache is being invalidate because project 2cc597a7bce54bff97ed91bdfcb45d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:45.520186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:45.520186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9b2f2ba1-b0e3-4579-9faa-e3189a48cb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:45.521263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1052/2112] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:45 2022] DELETE /identity/v3/projects/2cc597a7bce54bff97ed91bdfcb45d3e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:45.526521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:45.526890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:45.527173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:45.547716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:45.549057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:45.677800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1061/2113] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:45.685239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e511d4-ed2e-436d-8085-76876f14ad04 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:45.685507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e511d4-ed2e-436d-8085-76876f14ad04 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:45.686163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e511d4-ed2e-436d-8085-76876f14ad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:45.737832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:45.739823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:45.741174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:45.744120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-12e511d4-ed2e-436d-8085-76876f14ad04 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:45.745498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-12e511d4-ed2e-436d-8085-76876f14ad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:45.757960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561a5f7-5c52-4501-b3fd-0df9e435c93d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:45.764623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:45.768947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1053/2114] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:45.770071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:45.770692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:45.771359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] PATH_INFO: `/v3/users/9d17a26e32a04ede923da1f7690885d9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:45.775374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d17a26e32a04ede923da1f7690885d9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:45.777897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:45.782518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e511d4-ed2e-436d-8085-76876f14ad04 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:45.794934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e511d4-ed2e-436d-8085-76876f14ad04 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:45.801828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:45.802436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:45.802717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:45.802995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:45.803647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:45.804322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:45.806870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:45.829078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1054/2115] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:10:45.833667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:45.846377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501b29f-1422-4cf2-a4e2-c0cee9bff81d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:45.853921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:45.856468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:45.856468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:45.856468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:45.856468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:45.859824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:46.011824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1055/2116] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:45 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:46.012962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.062922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d17a26e32a04ede923da1f7690885d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:46.150941 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a3342-1ec9-4942-b948-5cca5bc624e7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:46.156363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:46.157285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.157840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.158319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.159558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:46.162545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:46.233188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d17a26e32a04ede923da1f7690885d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:46.243307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d17a26e32a04ede923da1f7690885d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:46.253546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d17a26e32a04ede923da1f7690885d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:46.262545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bccb4294-f468-4837-b35b-7752d5ccbffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d17a26e32a04ede923da1f7690885d9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:46.276188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1062/2117] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:45 2022] DELETE /identity/v3/users/9d17a26e32a04ede923da1f7690885d9 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:46.279635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.279968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.280339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.284839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1056/2118] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:46 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:46.286242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.289229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:46.313301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:46.315266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:46.319922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39a8ee-6c31-4dbb-bcc5-f99de1e83c57 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:46.386312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1063/2119] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:46.392042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:46.392666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.392952 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.393217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.393910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:46.395502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:46.395811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.397178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:46.408844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1057/2120] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:46.409972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.419533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d1e11-929e-43ad-bfcd-6b1aaf4e250f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:46.424151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:46.424741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.425018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.425288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.426254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:46.427934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:46.439233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1058/2121] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:46.445520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.455902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1b016-34b5-4def-8403-f754ef7f432f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:46.460613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:46.461008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbaf76-8547-4856-b615-f12bb84eb452 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:46.461250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.461528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.461831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] PATH_INFO: `/v3/projects/783fdadc82b24ff78abf9207552e4ff7/users/f6d24eb2b5a24dda9100a753f69c1957/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.464680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941ce5a-7c73-498f-980c-0d8f366a8f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:46.470188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941ce5a-7c73-498f-980c-0d8f366a8f0a service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.470188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941ce5a-7c73-498f-980c-0d8f366a8f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.470188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941ce5a-7c73-498f-980c-0d8f366a8f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.475482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941ce5a-7c73-498f-980c-0d8f366a8f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:46.478780 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941ce5a-7c73-498f-980c-0d8f366a8f0a service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:46.479928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=783fdadc82b24ff78abf9207552e4ff7, user_id=f6d24eb2b5a24dda9100a753f69c1957, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:46.482848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:46.490317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1064/2122] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:46.579600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1059/2123] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:46 2022] PUT /identity/v3/projects/783fdadc82b24ff78abf9207552e4ff7/users/f6d24eb2b5a24dda9100a753f69c1957/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:46.583309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466912e-74a6-41ff-9999-df85fc0194fa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.583603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466912e-74a6-41ff-9999-df85fc0194fa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.584040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466912e-74a6-41ff-9999-df85fc0194fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.621189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6466912e-74a6-41ff-9999-df85fc0194fa None None] MFA Rules not processed for user `f6d24eb2b5a24dda9100a753f69c1957`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:46.622437 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6466912e-74a6-41ff-9999-df85fc0194fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:46.690974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1065/2124] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:46.695680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.767409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b901-d245-4aba-b3ae-20497b69c7ed admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:46.776713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:46.777583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.778111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.778708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.779530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:46.781729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:46.902537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1060/2125] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:46 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:46.906438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466912e-74a6-41ff-9999-df85fc0194fa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.919690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466912e-74a6-41ff-9999-df85fc0194fa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:46.937147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:46.939893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:46.988928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:46.989557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:46.989903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:46.990189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:46.992113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:46.994602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.021749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6743d-9607-4c9d-bbf5-ae37314801a6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:47.027783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:47.028427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.028710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.028991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] PATH_INFO: `/v3/projects/79a4545d00f544509e5b74c2aaa99331` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.030190 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a4545d00f544509e5b74c2aaa99331)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:47.032141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.133090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1066/2126] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:46 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:47.135732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:47.144651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a4545d00f544509e5b74c2aaa99331', 'request_id': 'req-31fbd79a-70a2-47f5-9688-63bf47e4f56a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.146483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc8cbd-78b6-4124-8f13-2d72aba664d8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:47.153292 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a4545d00f544509e5b74c2aaa99331', 'request_id': 'req-31fbd79a-70a2-47f5-9688-63bf47e4f56a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.160024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a4545d00f544509e5b74c2aaa99331', 'request_id': 'req-31fbd79a-70a2-47f5-9688-63bf47e4f56a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.230827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:47.231505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.231788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.234917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.234917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:47.234917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.250247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1067/2127] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:47.253619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:47.266281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1f00e-3d3c-4a3f-9e45-e1a934a73551 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:47.271229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:47.271892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.272179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.272468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] PATH_INFO: `/v3/projects/73f42a0e0fc442e5812e7bccce24069e/users/5b16def268d248bf8b18c8f478162c9d/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.288641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f42a0e0fc442e5812e7bccce24069e, user_id=5b16def268d248bf8b18c8f478162c9d, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:47.292049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.325801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:47.331772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] The token cache is being invalidate because project 79a4545d00f544509e5b74c2aaa99331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:47.332203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.332906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.334583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1061/2128] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:46 2022] DELETE /identity/v3/projects/79a4545d00f544509e5b74c2aaa99331 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:47.338957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:47.340308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:47.353180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbd79a-70a2-47f5-9688-63bf47e4f56a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:47.365718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:47.367792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.367792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.367792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] PATH_INFO: `/v3/users/0d9a58196d5d4d8ea382d7b35d9a195a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.369204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9a58196d5d4d8ea382d7b35d9a195a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:47.373145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.422349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1068/2129] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:47 2022] PUT /identity/v3/projects/73f42a0e0fc442e5812e7bccce24069e/users/5b16def268d248bf8b18c8f478162c9d/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:47.434456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:47.436209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:47.525206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893c974-1d48-4c0e-812c-61de3b62a172 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:47.529900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:47.530514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.530812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.531088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.535008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:47.535008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.544867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1069/2130] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:10:47.548836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:47.550568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:47.613168 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b6a2-dffd-421f-8c91-0c1c4e42e6d0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:47.616851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:47.617464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.617749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.618059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.622503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:47.638211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9a58196d5d4d8ea382d7b35d9a195a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.639399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9a58196d5d4d8ea382d7b35d9a195a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.677755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:47.686921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:47.688859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.694819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9a58196d5d4d8ea382d7b35d9a195a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.698902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1070/2131] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:47.699694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:47.702860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9a58196d5d4d8ea382d7b35d9a195a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.711811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45195d5-66ef-47f1-99a5-b0d58e231bd5 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:47.725711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:47.726430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.726856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.727116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] PATH_INFO: `/v3/projects/73f42a0e0fc442e5812e7bccce24069e/users/5b16def268d248bf8b18c8f478162c9d/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.731294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f42a0e0fc442e5812e7bccce24069e, user_id=5b16def268d248bf8b18c8f478162c9d, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:47.735178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:47.741010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dffefee2-b2ab-4255-83b4-3477874fe661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9a58196d5d4d8ea382d7b35d9a195a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:47.747512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1062/2132] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:47 2022] DELETE /identity/v3/users/0d9a58196d5d4d8ea382d7b35d9a195a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:47.748690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1071/2133] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:47 2022] PUT /identity/v3/projects/73f42a0e0fc442e5812e7bccce24069e/users/5b16def268d248bf8b18c8f478162c9d/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:47.760345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:47.760714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:47.761051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:47.794755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] MFA Rules not processed for user `5b16def268d248bf8b18c8f478162c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:47.796784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:47.873979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1063/2134] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:47.885557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:47.887238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:47.946643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141d385-5b90-43f8-aeca-4102dcf7971e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:48.006576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:48.007214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:48.007496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:48.007772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:48.009704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:48.087869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:48.089326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:48.098987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1072/2135] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:48.220769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:48.222618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:48.300596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ee20a-b27e-4d7e-9180-0877356f3e68 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:48.307397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:48.308403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:48.308732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:48.309027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] PATH_INFO: `/v3/projects/9d8bbb0553d246b2a5bf5e7347e1edbf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:48.313154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8bbb0553d246b2a5bf5e7347e1edbf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:48.315247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:48.473266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8bbb0553d246b2a5bf5e7347e1edbf', 'request_id': 'req-2fa20ae6-7e04-42c9-93ae-f6993b59e325'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.482680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8bbb0553d246b2a5bf5e7347e1edbf', 'request_id': 'req-2fa20ae6-7e04-42c9-93ae-f6993b59e325'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.489462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8bbb0553d246b2a5bf5e7347e1edbf', 'request_id': 'req-2fa20ae6-7e04-42c9-93ae-f6993b59e325'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.560199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] The token cache is being invalidate because project 9d8bbb0553d246b2a5bf5e7347e1edbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:48.560493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.561151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.566051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1064/2136] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:48 2022] DELETE /identity/v3/projects/9d8bbb0553d246b2a5bf5e7347e1edbf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:48.567377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:48.581162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd321cd-1dbb-4473-885b-df3de395ac5a service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:48.655493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:48.656127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:48.656419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:48.656686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] PATH_INFO: `/v3/users/ae48d5b91ab9451aaf1b1653ce26ffc4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:48.657901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae48d5b91ab9451aaf1b1653ce26ffc4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:48.659840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:48.830599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae48d5b91ab9451aaf1b1653ce26ffc4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.904524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae48d5b91ab9451aaf1b1653ce26ffc4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.912056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae48d5b91ab9451aaf1b1653ce26ffc4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.912870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae48d5b91ab9451aaf1b1653ce26ffc4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.926419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae48d5b91ab9451aaf1b1653ce26ffc4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:48.933400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1073/2137] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:48 2022] DELETE /identity/v3/users/ae48d5b91ab9451aaf1b1653ce26ffc4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:49.185273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:49.186939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:49.249152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa20ae6-7e04-42c9-93ae-f6993b59e325 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:49.302819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33adea9-43ec-47fe-9f64-ee9e48e5c060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:49.303428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33adea9-43ec-47fe-9f64-ee9e48e5c060 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:49.303706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33adea9-43ec-47fe-9f64-ee9e48e5c060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:49.303974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33adea9-43ec-47fe-9f64-ee9e48e5c060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:49.305745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d33adea9-43ec-47fe-9f64-ee9e48e5c060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:49.391580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33adea9-43ec-47fe-9f64-ee9e48e5c060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:49.393642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33adea9-43ec-47fe-9f64-ee9e48e5c060 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:49.407127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:49.413119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1065/2138] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:49.465036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:49.466743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:49.545928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0208c4-85c9-46a6-82b8-9c0c9c49acbe admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:49.551726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:49.553524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:49.554024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:49.554534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:49.554946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] PATH_INFO: `/v3/projects/6294215c6aed4fb58e7822ecf80acbc5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:49.557235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6294215c6aed4fb58e7822ecf80acbc5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:49.559863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:49.703903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6294215c6aed4fb58e7822ecf80acbc5', 'request_id': 'req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:49.709985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6294215c6aed4fb58e7822ecf80acbc5', 'request_id': 'req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:49.717611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6294215c6aed4fb58e7822ecf80acbc5', 'request_id': 'req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:49.843491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] The token cache is being invalidate because project 6294215c6aed4fb58e7822ecf80acbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:49.844143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:49.846812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1acbd2e1-dac7-464f-a9ae-5b5683acb9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:49.850956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1074/2139] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:49 2022] DELETE /identity/v3/projects/6294215c6aed4fb58e7822ecf80acbc5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:49.856892 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7b8e-1171-4ae8-864e-2b9b76350c60 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:49.857182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7b8e-1171-4ae8-864e-2b9b76350c60 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:49.857460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de7b8e-1171-4ae8-864e-2b9b76350c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:49.891082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b9de7b8e-1171-4ae8-864e-2b9b76350c60 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:49.892301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b9de7b8e-1171-4ae8-864e-2b9b76350c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:49.989511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1066/2140] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:49.992154 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0646-fe45-4632-8ebb-b4f238a61ff2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:49.992325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0646-fe45-4632-8ebb-b4f238a61ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:49.992789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca0646-fe45-4632-8ebb-b4f238a61ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.027630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-55ca0646-fe45-4632-8ebb-b4f238a61ff2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:50.028854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-55ca0646-fe45-4632-8ebb-b4f238a61ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:50.038072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1075/2141] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:50.043400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7b8e-1171-4ae8-864e-2b9b76350c60 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:50.055433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de7b8e-1171-4ae8-864e-2b9b76350c60 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:50.064340 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:50.065269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.065563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.065883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.070345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:50.070345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:50.070345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:50.086192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1067/2142] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:50.087646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca0646-fe45-4632-8ebb-b4f238a61ff2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:50.098551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca0646-fe45-4632-8ebb-b4f238a61ff2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:50.104192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:50.105381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.106022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.106133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.107463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:50.109037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:50.157591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:50.256469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1076/2143] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:50 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:50.261225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:50.272496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997dec-dcc8-4dc5-bc17-72f44e9f5d6e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:50.337858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:50.338403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.338731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.339069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.339726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:50.341667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:50.464354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1068/2144] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:50 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:50.465637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:50.476466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0bbbe-063d-491d-9c8d-b35d46af5a2b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:50.484121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:50.486508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.486508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.486508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.486508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:50.487760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:50.509414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1077/2145] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:50.510604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:50.522980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5f006-c2d7-42f1-b7a5-46bd91516d5c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:50.528259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710537-a57b-4643-b3da-0738beed49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:50.532325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710537-a57b-4643-b3da-0738beed49ba admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.532325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710537-a57b-4643-b3da-0738beed49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.532325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710537-a57b-4643-b3da-0738beed49ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.532325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710537-a57b-4643-b3da-0738beed49ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:50.532325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5710537-a57b-4643-b3da-0738beed49ba admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:50.547552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1069/2146] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:50.548514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:50.559546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e437a-44a0-419e-8871-78b1d6728059 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:50.564640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:50.565505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.565967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.566374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] PATH_INFO: `/v3/projects/5a8f047e577a4d20b484bd1ccd475eeb/users/2d23717d208b4d90879f6c24b692500b/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.582529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8f047e577a4d20b484bd1ccd475eeb, user_id=2d23717d208b4d90879f6c24b692500b, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:50.585424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:50.718255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1078/2147] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:50 2022] PUT /identity/v3/projects/5a8f047e577a4d20b484bd1ccd475eeb/users/2d23717d208b4d90879f6c24b692500b/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:50.732313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f8904-1743-4d22-afcc-4da5b3177fd7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.732313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f8904-1743-4d22-afcc-4da5b3177fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.732313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f8904-1743-4d22-afcc-4da5b3177fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.764209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8a8f8904-1743-4d22-afcc-4da5b3177fd7 None None] MFA Rules not processed for user `2d23717d208b4d90879f6c24b692500b`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:50.765557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8a8f8904-1743-4d22-afcc-4da5b3177fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:50.867852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1070/2148] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:50.873140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:50.963933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b9f6c-817b-4144-92ea-5f6ddf35ca8c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:50.968146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:50.968858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:50.969259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:50.969600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:50.970335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:50.972361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:50.987091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:51.073485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1079/2149] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:50 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:51.077744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f8904-1743-4d22-afcc-4da5b3177fd7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:51.088997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f8904-1743-4d22-afcc-4da5b3177fd7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:51.153237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:51.153688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:51.154012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:51.154335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:51.155636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:51.157615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:51.455521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1071/2150] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:51 2022] POST /identity/v3/users => generated 293 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:51.459668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:51.469929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b243d-62a9-4621-8e5e-2a181e1914cd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:51.476768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:51.476768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:51.476768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:51.476768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:51.477140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:51.478192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:51.488839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1080/2151] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:51.493353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:51.506346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9962e55-a84e-4df9-a113-9398e35e3e56 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:51.530756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101b503-4808-4a65-8d3d-7cb20d61a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:51.534434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b503-4808-4a65-8d3d-7cb20d61a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:51.534434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b503-4808-4a65-8d3d-7cb20d61a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:51.534434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101b503-4808-4a65-8d3d-7cb20d61a0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:51.534434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b503-4808-4a65-8d3d-7cb20d61a0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:51.535372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101b503-4808-4a65-8d3d-7cb20d61a0a3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:51.548698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1072/2152] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:51.552797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:51.578465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb998-3e49-454d-ac07-7a6626775e0d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:51.604016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:51.604016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:51.604761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:51.604761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] PATH_INFO: `/v3/projects/bf4f7441dd744062a9508fd4de185a0e/users/015e74ad4992478886c538d6de130ab6/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:51.624668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4f7441dd744062a9508fd4de185a0e, user_id=015e74ad4992478886c538d6de130ab6, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:51.631887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:51.726802 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e080-f5ce-411b-9b78-425d9f307c9e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:51.727281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e080-f5ce-411b-9b78-425d9f307c9e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:51.728709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e080-f5ce-411b-9b78-425d9f307c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:51.735462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1081/2153] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:51 2022] PUT /identity/v3/projects/bf4f7441dd744062a9508fd4de185a0e/users/015e74ad4992478886c538d6de130ab6/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:51.767865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-be29e080-f5ce-411b-9b78-425d9f307c9e None None] MFA Rules not processed for user `015e74ad4992478886c538d6de130ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:51.769171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-be29e080-f5ce-411b-9b78-425d9f307c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:51.857394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1073/2154] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:51.862032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:51.934958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddb94-7307-4e9b-953e-d314690f5947 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:51.955767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:51.956030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:51.956510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:51.957725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:51.958765 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:51.960469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:52.041184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1082/2155] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:51 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:52.042742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29e080-f5ce-411b-9b78-425d9f307c9e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:52.054677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29e080-f5ce-411b-9b78-425d9f307c9e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:52.079581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:52.128339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:52.128959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:52.129238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:52.129511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:52.130206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:52.132504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:52.247793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1074/2156] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:52 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:10:52.250957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:52.265595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145f5a8-e353-4152-b565-b432066a637d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:52.281861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:52.281861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:52.282169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:52.282447 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:52.283111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:52.284734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:52.297822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1083/2157] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:52.302876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:52.313543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe0d9d-143d-4d7b-9e27-a5fb91690a86 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:52.318637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:52.319313 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:52.319595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:52.319890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] PATH_INFO: `/v3/projects/d5fb7f343aa44ca3b80e17153b9c6692/users/1e20ffce80f148f5832728dd8a1528f4/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:52.361139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fb7f343aa44ca3b80e17153b9c6692, user_id=1e20ffce80f148f5832728dd8a1528f4, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:52.364825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:52.452984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1075/2158] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:52 2022] PUT /identity/v3/projects/d5fb7f343aa44ca3b80e17153b9c6692/users/1e20ffce80f148f5832728dd8a1528f4/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:52.454085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:52.465243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65233-7096-4e9e-a835-a58d9ffb1b96 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:52.533978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2e991-7116-4af3-8664-c7f8503bcc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:52.534638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e991-7116-4af3-8664-c7f8503bcc6f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:52.535001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e991-7116-4af3-8664-c7f8503bcc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:52.535346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2e991-7116-4af3-8664-c7f8503bcc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:52.536121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2e991-7116-4af3-8664-c7f8503bcc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:52.538347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2e991-7116-4af3-8664-c7f8503bcc6f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:52.550266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1084/2159] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:52.554451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:52.565529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0122-72b1-48a5-9f90-6ff4d8097523 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:52.570935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:52.577249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:52.577249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:52.577249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] PATH_INFO: `/v3/projects/d5fb7f343aa44ca3b80e17153b9c6692/users/1e20ffce80f148f5832728dd8a1528f4/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:52.577249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fb7f343aa44ca3b80e17153b9c6692, user_id=1e20ffce80f148f5832728dd8a1528f4, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:52.577749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:52.589304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1076/2160] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:52 2022] PUT /identity/v3/projects/d5fb7f343aa44ca3b80e17153b9c6692/users/1e20ffce80f148f5832728dd8a1528f4/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:52.601015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75006-d125-4950-b89b-c615c8fdc666 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:52.601562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75006-d125-4950-b89b-c615c8fdc666 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:52.601796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc75006-d125-4950-b89b-c615c8fdc666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:52.642265 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2bc75006-d125-4950-b89b-c615c8fdc666 None None] MFA Rules not processed for user `1e20ffce80f148f5832728dd8a1528f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:52.643690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2bc75006-d125-4950-b89b-c615c8fdc666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:52.747384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1085/2161] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:52.759359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:52.762419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:52.822740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c84a-f2d9-44a5-8d31-5eea9db8c0dd admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:52.834494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:52.835627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:52.835859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:52.836117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:52.897374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:52.898860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:52.908591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1077/2162] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:52.910734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:53.803253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc75006-d125-4950-b89b-c615c8fdc666 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:53.813445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc75006-d125-4950-b89b-c615c8fdc666 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:53.817073 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa4919-5065-400e-8858-eb820ceecb52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:53.817703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4919-5065-400e-8858-eb820ceecb52 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:53.818107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4919-5065-400e-8858-eb820ceecb52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:53.818298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa4919-5065-400e-8858-eb820ceecb52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:53.820034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ddaa4919-5065-400e-8858-eb820ceecb52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:53.885864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa4919-5065-400e-8858-eb820ceecb52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:53.887330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa4919-5065-400e-8858-eb820ceecb52 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:53.896837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1086/2163] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:54.077627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:54.526145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:54.549289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:54.550839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:54.621437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1993d-62e1-4508-b1ff-ebd090693da0 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:54.626208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:54.626849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:54.627128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:54.627400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] PATH_INFO: `/v3/users/42ea05bd67f44dda9111d2d49745d7e0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:54.628517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ea05bd67f44dda9111d2d49745d7e0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:54.630473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:54.794657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ea05bd67f44dda9111d2d49745d7e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:54.795312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ea05bd67f44dda9111d2d49745d7e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:54.870974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ea05bd67f44dda9111d2d49745d7e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:54.878786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ea05bd67f44dda9111d2d49745d7e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:54.890556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ea05bd67f44dda9111d2d49745d7e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:54.902330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1078/2164] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:54 2022] DELETE /identity/v3/users/42ea05bd67f44dda9111d2d49745d7e0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:54.906898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:54.907356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:54.908872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:54.928327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:54.929695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:54.933676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:54.935218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:54.993315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1087/2165] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:54.996229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c20d1-012f-4633-8f4c-dd74932fabfe admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:55.000261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:55.000876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:55.001157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:55.001420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:55.003241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:55.006540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:55.006540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:55.068808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105bfa1-b841-49e2-8ecd-6b1da87dbbdb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:55.072491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:55.073278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:55.073558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:55.073695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:55.073931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:55.075150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:55.082963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:55.083920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1079/2166] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:55.084457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:55.095251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1088/2167] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:55.556258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:55.563850 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:55.565342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:55.581544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eb982-8d51-4304-be27-e26c415bc910 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:55.594522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:55.594522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:55.594522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:55.594522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] PATH_INFO: `/v3/projects/955f4af9c40c4dad971b6c2150d4dffc` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:55.595029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955f4af9c40c4dad971b6c2150d4dffc)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:55.595335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:55.705387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955f4af9c40c4dad971b6c2150d4dffc', 'request_id': 'req-77b902e6-16e7-431c-863d-6a0e3e2dc448'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:55.711945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955f4af9c40c4dad971b6c2150d4dffc', 'request_id': 'req-77b902e6-16e7-431c-863d-6a0e3e2dc448'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:55.724454 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955f4af9c40c4dad971b6c2150d4dffc', 'request_id': 'req-77b902e6-16e7-431c-863d-6a0e3e2dc448'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:55.802731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] The token cache is being invalidate because project 955f4af9c40c4dad971b6c2150d4dffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:55.803047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:55.803681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:55.805242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1080/2168] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:55 2022] DELETE /identity/v3/projects/955f4af9c40c4dad971b6c2150d4dffc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:55.809983 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:55.819806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e723c0b-ac3e-43fb-a216-d669fa6bfcb0 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:55.844158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:55.899116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:55.899953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:55.901421 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:55.901569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] PATH_INFO: `/v3/users/19874af4c80b4a569f2dd7925f45a2cc` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:55.902684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=19874af4c80b4a569f2dd7925f45a2cc)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:55.904664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:56.132342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19874af4c80b4a569f2dd7925f45a2cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:56.209039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19874af4c80b4a569f2dd7925f45a2cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:56.217786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19874af4c80b4a569f2dd7925f45a2cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:56.219387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19874af4c80b4a569f2dd7925f45a2cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:56.241537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19874af4c80b4a569f2dd7925f45a2cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:56.251720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1089/2169] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:55 2022] DELETE /identity/v3/users/19874af4c80b4a569f2dd7925f45a2cc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:56.675721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:56.677130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:56.736807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:56.741432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:56.742194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b902e6-16e7-431c-863d-6a0e3e2dc448 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:56.796871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:56.804187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:56.804187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:56.804187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:56.804187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:56.815443 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1ba5-e398-4e7b-a6cd-af0f70eb06ea admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:56.820149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:56.820778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:56.821061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:56.821336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] PATH_INFO: `/v3/projects/b66fda915e2c44109863ab685452e533` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:56.823833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66fda915e2c44109863ab685452e533)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:56.825905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:56.866912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:56.868354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:56.878615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1081/2170] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:10:56.969442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66fda915e2c44109863ab685452e533', 'request_id': 'req-5682ca92-aa66-4b1a-b389-644fb9d158ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:56.975446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66fda915e2c44109863ab685452e533', 'request_id': 'req-5682ca92-aa66-4b1a-b389-644fb9d158ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:56.983050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66fda915e2c44109863ab685452e533', 'request_id': 'req-5682ca92-aa66-4b1a-b389-644fb9d158ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.038760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:57.099707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] The token cache is being invalidate because project b66fda915e2c44109863ab685452e533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:57.100003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.100898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.102570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1090/2171] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:56 2022] DELETE /identity/v3/projects/b66fda915e2c44109863ab685452e533 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:57.109904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:57.121615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7fb07d-3c00-4e45-999c-dde621f34867 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:57.177649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:57.219457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:57.221900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:57.221900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:57.221900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] PATH_INFO: `/v3/users/e0dc663c4ad644efa99b7ef1d384ea1b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:57.222222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0dc663c4ad644efa99b7ef1d384ea1b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:57.224171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:57.481014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0dc663c4ad644efa99b7ef1d384ea1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.481747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0dc663c4ad644efa99b7ef1d384ea1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.567814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0dc663c4ad644efa99b7ef1d384ea1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.576805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0dc663c4ad644efa99b7ef1d384ea1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.590244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0dc663c4ad644efa99b7ef1d384ea1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:57.596594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1082/2172] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:57 2022] DELETE /identity/v3/users/e0dc663c4ad644efa99b7ef1d384ea1b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:57.681445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:57.686877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:57.697435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682ca92-aa66-4b1a-b389-644fb9d158ba admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:57.756030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:57.756694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:57.756981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:57.757302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] PATH_INFO: `/v3/users/f0f0d32dfe614e55af8b1e1e0743eda4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:57.758439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f0d32dfe614e55af8b1e1e0743eda4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:57.761005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:57.995403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f0d32dfe614e55af8b1e1e0743eda4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.077869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f0d32dfe614e55af8b1e1e0743eda4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.086756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:58.088753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:58.098018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f0d32dfe614e55af8b1e1e0743eda4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.101123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f0d32dfe614e55af8b1e1e0743eda4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.109428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbeffd-ca6f-427b-8e63-e113e0dbf846 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:58.117278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:58.118043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:58.118399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:58.119405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] PATH_INFO: `/v3/projects/10deca7e670c4bbcb40d81d9d230914b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:58.120948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10deca7e670c4bbcb40d81d9d230914b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:58.123212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:58.124431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa84b22b-ad90-4fcd-b28e-1ab2e0d325a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f0d32dfe614e55af8b1e1e0743eda4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.133184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1091/2173] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:57 2022] DELETE /identity/v3/users/f0f0d32dfe614e55af8b1e1e0743eda4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:58.137714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:58.138222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:58.138507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:58.175603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:58.176823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:58.246369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10deca7e670c4bbcb40d81d9d230914b', 'request_id': 'req-956a1e81-b261-4331-a085-6aa333685767'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.256059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10deca7e670c4bbcb40d81d9d230914b', 'request_id': 'req-956a1e81-b261-4331-a085-6aa333685767'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.269428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10deca7e670c4bbcb40d81d9d230914b', 'request_id': 'req-956a1e81-b261-4331-a085-6aa333685767'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.270834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1092/2174] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:10:58.283020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:58.285483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:58.351230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40f33-16c3-46b8-a86d-90bb42ffac63 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:58.354123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] The token cache is being invalidate because project 10deca7e670c4bbcb40d81d9d230914b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:58.354123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.354123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:58.361840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1083/2175] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:58 2022] DELETE /identity/v3/projects/10deca7e670c4bbcb40d81d9d230914b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:10:58.474345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726048f1-0708-4407-b1e1-bdfec34d5cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:58.474345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726048f1-0708-4407-b1e1-bdfec34d5cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:58.474345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726048f1-0708-4407-b1e1-bdfec34d5cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:58.474345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726048f1-0708-4407-b1e1-bdfec34d5cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:58.474738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-726048f1-0708-4407-b1e1-bdfec34d5cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:58.555916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726048f1-0708-4407-b1e1-bdfec34d5cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:58.558489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726048f1-0708-4407-b1e1-bdfec34d5cc2 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:58.571144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1093/2176] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:10:59.089084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.090768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:59.105590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1e81-b261-4331-a085-6aa333685767 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.110762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.111412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.111699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.111980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] PATH_INFO: `/v3/projects/bb5b87c75cea4041890816348157f2ca` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.117929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5b87c75cea4041890816348157f2ca)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:59.119968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:59.274594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5b87c75cea4041890816348157f2ca', 'request_id': 'req-595edf5d-1109-469a-ac8e-93a3bc768950'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:59.281997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5b87c75cea4041890816348157f2ca', 'request_id': 'req-595edf5d-1109-469a-ac8e-93a3bc768950'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:59.287581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5b87c75cea4041890816348157f2ca', 'request_id': 'req-595edf5d-1109-469a-ac8e-93a3bc768950'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:59.376718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] The token cache is being invalidate because project bb5b87c75cea4041890816348157f2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:10:59.377194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:59.380237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-595edf5d-1109-469a-ac8e-93a3bc768950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:10:59.383368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1084/2177] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:10:59 2022] DELETE /identity/v3/projects/bb5b87c75cea4041890816348157f2ca => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:10:59.389969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd96d-c225-469f-a0e9-8fb9ad903f7c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.390696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd96d-c225-469f-a0e9-8fb9ad903f7c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.390696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd96d-c225-469f-a0e9-8fb9ad903f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.391097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:59.415216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-36cdd96d-c225-469f-a0e9-8fb9ad903f7c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:59.416468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-36cdd96d-c225-469f-a0e9-8fb9ad903f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:59.480767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1094/2178] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:59.489357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b08fc4-c4a4-439f-a48e-773ba7b81b17 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.489659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b08fc4-c4a4-439f-a48e-773ba7b81b17 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.489987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b08fc4-c4a4-439f-a48e-773ba7b81b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.510982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f4b08fc4-c4a4-439f-a48e-773ba7b81b17 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:10:59.512201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f4b08fc4-c4a4-439f-a48e-773ba7b81b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:59.520373 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1085/2179] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:10:59.524526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd96d-c225-469f-a0e9-8fb9ad903f7c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.535100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd96d-c225-469f-a0e9-8fb9ad903f7c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.539766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.540363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.540681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.541218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.541590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:10:59.541935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:59.543535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:59.554999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1095/2180] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:10:59.559829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b08fc4-c4a4-439f-a48e-773ba7b81b17 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.568951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b08fc4-c4a4-439f-a48e-773ba7b81b17 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.574973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.575570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.575854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.576128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.576765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:59.578690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:59.678926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1086/2181] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:10:59 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:59.684543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.694566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8f6c-e0b3-4132-8ac1-aee6f6f6838f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.754872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.755505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.755777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.756057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.756820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:59.758887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:59.843674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1096/2182] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:10:59 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:10:59.847703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.858415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65db36-506a-4ba0-8220-a89caf610363 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.867193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.867797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.868225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.868500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.869753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:59.871446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:59.881590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1087/2183] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:59.886473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.896619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab46e84-3642-4e7e-8162-9f558c37289d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.901342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.905198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.905198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.905198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.905198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:59.905198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:59.915402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1097/2184] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:10:59.920300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.930575 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7c74-b77a-421f-a8f8-2c118f6eee3f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.936103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f9a6b-6175-41db-af12-3d35f1431cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.936745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f9a6b-6175-41db-af12-3d35f1431cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.937024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f9a6b-6175-41db-af12-3d35f1431cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:10:59.937339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f9a6b-6175-41db-af12-3d35f1431cb3 admin admin] PATH_INFO: `/v3/projects/42eb8aea35954d7d8ba6c0192cd28468/users/247cf94bcddb4971b7dee68ae3168237/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:10:59.952395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f9a6b-6175-41db-af12-3d35f1431cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42eb8aea35954d7d8ba6c0192cd28468, user_id=247cf94bcddb4971b7dee68ae3168237, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:10:59.955074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f9a6b-6175-41db-af12-3d35f1431cb3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:10:59.975735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:10:59.977442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:10:59.991035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460b5f-5dd1-4472-9a25-93f1b1bd8968 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:10:59.996813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:10:59.997877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:10:59.999336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:10:59.999943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:00.000339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] PATH_INFO: `/v3/users/f6d24eb2b5a24dda9100a753f69c1957` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:00.001603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d24eb2b5a24dda9100a753f69c1957)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:00.003575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:00.043381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1088/2185] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:10:59 2022] PUT /identity/v3/projects/42eb8aea35954d7d8ba6c0192cd28468/users/247cf94bcddb4971b7dee68ae3168237/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:11:00.045701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:00.046028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:00.046306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:00.202132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:00.203347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:00.264894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1089/2186] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:11:00.281505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:00.282963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:00.341832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7c70c-ad85-4e81-803d-c57854a55b8f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:00.345484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff40e3-5f00-48ab-98e7-3352bd289d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:00.346132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff40e3-5f00-48ab-98e7-3352bd289d30 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:00.346415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff40e3-5f00-48ab-98e7-3352bd289d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:00.346689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff40e3-5f00-48ab-98e7-3352bd289d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:00.357755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff40e3-5f00-48ab-98e7-3352bd289d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:00.359256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff40e3-5f00-48ab-98e7-3352bd289d30 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:00.368566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1090/2187] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:11:00.462424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d24eb2b5a24dda9100a753f69c1957'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:00.575589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d24eb2b5a24dda9100a753f69c1957'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:00.583694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d24eb2b5a24dda9100a753f69c1957'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:00.584393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d24eb2b5a24dda9100a753f69c1957'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:00.606295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d24eb2b5a24dda9100a753f69c1957'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:00.612869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1098/2188] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:10:59 2022] DELETE /identity/v3/users/f6d24eb2b5a24dda9100a753f69c1957 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:11:00.617336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:00.617622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:00.617921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:00.781732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:00.784493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:00.878067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1091/2189] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:11:00.887776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:00.889348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:00.953080 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e0ec2-d6d9-44bf-8a35-92aed99e880f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:00.963031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:00.963031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:00.963031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:00.963031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:00.969789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:00.969789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:00.981045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1099/2190] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:01.409549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:01.618586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:01.622490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:01.635367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad491679-c23f-47e9-a2b5-b73d0ca79779 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:01.640963 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:01.651121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:01.651524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:01.651649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] PATH_INFO: `/v3/projects/783fdadc82b24ff78abf9207552e4ff7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:01.660664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783fdadc82b24ff78abf9207552e4ff7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:01.660664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:01.801016 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783fdadc82b24ff78abf9207552e4ff7', 'request_id': 'req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:01.808733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783fdadc82b24ff78abf9207552e4ff7', 'request_id': 'req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:01.814547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783fdadc82b24ff78abf9207552e4ff7', 'request_id': 'req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:01.887580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] The token cache is being invalidate because project 783fdadc82b24ff78abf9207552e4ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:11:01.887884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:01.890207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:01.894740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1092/2191] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:11:01 2022] DELETE /identity/v3/projects/783fdadc82b24ff78abf9207552e4ff7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:11:01.895867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:01.906466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:01.907930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:01.912023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ecc90-708d-47d3-ba54-1383f3053f34 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:02.050612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9d22f-f4af-4b1b-9fe9-ed1189343f36 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:02.057113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:02.057792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:02.058093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:02.058352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] PATH_INFO: `/v3/users/5b16def268d248bf8b18c8f478162c9d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:02.061199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:02.062545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:02.062945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b16def268d248bf8b18c8f478162c9d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:02.063402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:02.064128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] PATH_INFO: `/v3/users/2d23717d208b4d90879f6c24b692500b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:02.065876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d23717d208b4d90879f6c24b692500b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:02.069835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:02.071227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:02.220816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:02.314168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d23717d208b4d90879f6c24b692500b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.316160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d23717d208b4d90879f6c24b692500b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.393075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d23717d208b4d90879f6c24b692500b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.404500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d23717d208b4d90879f6c24b692500b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.409308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b16def268d248bf8b18c8f478162c9d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.421200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebe9b844-fded-4385-ae29-3131c347dbdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d23717d208b4d90879f6c24b692500b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.428350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1093/2192] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:11:01 2022] DELETE /identity/v3/users/2d23717d208b4d90879f6c24b692500b => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:11:02.437676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:02.438050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:02.438325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:02.460046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b16def268d248bf8b18c8f478162c9d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.470520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b16def268d248bf8b18c8f478162c9d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.471250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b16def268d248bf8b18c8f478162c9d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.485278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:02.488354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b16def268d248bf8b18c8f478162c9d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:02.490061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:02.507731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1100/2193] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:11:01 2022] DELETE /identity/v3/users/5b16def268d248bf8b18c8f478162c9d => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:02.589907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1094/2194] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:02.601355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:02.603281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:02.684561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d722-0f0f-4396-9809-e8d4ed8fc8ed admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:02.689320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:02.689320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:02.695790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:02.695790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:02.803519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:02.805833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:02.818122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1101/2195] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:03.011524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:03.107625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:03.113675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:03.136320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef818d-8cc2-41b6-99c0-fb099c1215ca None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:03.151460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:03.152230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:03.152588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:03.152939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] PATH_INFO: `/v3/projects/73f42a0e0fc442e5812e7bccce24069e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:03.154701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f42a0e0fc442e5812e7bccce24069e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:03.159138 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:03.380685 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f42a0e0fc442e5812e7bccce24069e', 'request_id': 'req-4958be8a-b83f-4889-8c63-c3fce43667b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.395374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f42a0e0fc442e5812e7bccce24069e', 'request_id': 'req-4958be8a-b83f-4889-8c63-c3fce43667b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.405905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f42a0e0fc442e5812e7bccce24069e', 'request_id': 'req-4958be8a-b83f-4889-8c63-c3fce43667b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.443193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:03.443193 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:03.458732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378b7c0-9d02-4e14-b918-527168276065 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:03.505409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] The token cache is being invalidate because project 73f42a0e0fc442e5812e7bccce24069e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:11:03.506007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.506480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4958be8a-b83f-4889-8c63-c3fce43667b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.509107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1095/2196] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:11:03 2022] DELETE /identity/v3/projects/73f42a0e0fc442e5812e7bccce24069e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:03.517536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53290ad-aed3-4195-a211-a8aec105ca9a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:03.517854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53290ad-aed3-4195-a211-a8aec105ca9a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:03.518121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53290ad-aed3-4195-a211-a8aec105ca9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:03.552497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:03.565163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d53290ad-aed3-4195-a211-a8aec105ca9a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:03.567512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d53290ad-aed3-4195-a211-a8aec105ca9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:03.582125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:03.583631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:03.584683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:03.585401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] PATH_INFO: `/v3/projects/5a8f047e577a4d20b484bd1ccd475eeb` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:03.587490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8f047e577a4d20b484bd1ccd475eeb)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:03.592318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:03.681916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1096/2197] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:03.688598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39bb82-4ca8-4e45-a788-2ab66fa1bed1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:03.689750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39bb82-4ca8-4e45-a788-2ab66fa1bed1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:03.689750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39bb82-4ca8-4e45-a788-2ab66fa1bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:03.713746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7e39bb82-4ca8-4e45-a788-2ab66fa1bed1 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:03.714976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7e39bb82-4ca8-4e45-a788-2ab66fa1bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:03.729814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1097/2198] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:11:03.731640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39bb82-4ca8-4e45-a788-2ab66fa1bed1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:03.741853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39bb82-4ca8-4e45-a788-2ab66fa1bed1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:03.750252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:03.751066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:03.759058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:03.759058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:03.759058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:11:03.759058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:03.759058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:03.767576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1098/2199] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:11:03.769512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8f047e577a4d20b484bd1ccd475eeb', 'request_id': 'req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.771784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:03.779528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8f047e577a4d20b484bd1ccd475eeb', 'request_id': 'req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.782982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15216-de00-41fd-bd64-cc0678ca8f23 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:03.788822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8f047e577a4d20b484bd1ccd475eeb', 'request_id': 'req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.860074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:03.860074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:03.860074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:03.860074 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:03.860662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:03.861175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:03.936201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] The token cache is being invalidate because project 5a8f047e577a4d20b484bd1ccd475eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:11:03.936791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.938165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:03.940732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1102/2200] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:11:03 2022] DELETE /identity/v3/projects/5a8f047e577a4d20b484bd1ccd475eeb => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:03.946790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:03.950011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:03.982724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fc5e3-a88a-4a3d-8513-c7bd7b5fa48a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:03.982724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:03.982724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:03.982724 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:03.983045 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] PATH_INFO: `/v3/users/015e74ad4992478886c538d6de130ab6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:03.983879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=015e74ad4992478886c538d6de130ab6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:03.986102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:04.021796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1099/2201] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:11:03 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:11:04.022972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:04.028191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:04.132930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4716e-e8e3-4425-be5b-65d9b11b7880 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:04.138926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:04.139544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:04.140128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:04.140128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:04.140820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:04.142857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:04.190468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015e74ad4992478886c538d6de130ab6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:04.328891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1100/2202] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:11:04 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:11:04.332998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:04.343518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a695f-90db-4ee4-86ba-4a1aa6ff687a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:04.346937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015e74ad4992478886c538d6de130ab6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:04.349608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:04.351683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:04.358376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:04.358376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:04.358376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:04.358376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:04.363727 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015e74ad4992478886c538d6de130ab6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:04.364965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015e74ad4992478886c538d6de130ab6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:04.379992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1101/2203] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:04.386862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:04.392317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015e74ad4992478886c538d6de130ab6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:04.401043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1103/2204] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:11:03 2022] DELETE /identity/v3/users/015e74ad4992478886c538d6de130ab6 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:04.406662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f895fc-9c26-479a-b155-a522843522ad admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:04.492602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:04.514558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518f4b2-bd8b-495f-bda7-368a0e2e2975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:04.515886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f4b2-bd8b-495f-bda7-368a0e2e2975 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:04.516331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f4b2-bd8b-495f-bda7-368a0e2e2975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:04.516749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518f4b2-bd8b-495f-bda7-368a0e2e2975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:04.517550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f4b2-bd8b-495f-bda7-368a0e2e2975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:04.520720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518f4b2-bd8b-495f-bda7-368a0e2e2975 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:04.538122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1102/2205] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:04.542812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:04.544276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:04.562150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1386e-a6fa-4663-861a-77711609c79e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:04.578088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:04.579852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:04.579852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:04.579852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] PATH_INFO: `/v3/projects/0a8d27b0e4294f3aabbcb9eaa00fa614/users/4f94e32e48ad4a0285af6fa0b3643ec7/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:04.601869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8d27b0e4294f3aabbcb9eaa00fa614, user_id=4f94e32e48ad4a0285af6fa0b3643ec7, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:04.607836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:04.685190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1104/2206] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:11:04 2022] PUT /identity/v3/projects/0a8d27b0e4294f3aabbcb9eaa00fa614/users/4f94e32e48ad4a0285af6fa0b3643ec7/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:04.698870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:04.699261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:04.699644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:04.751576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] MFA Rules not processed for user `4f94e32e48ad4a0285af6fa0b3643ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:04.752882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:04.843665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1103/2207] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:04.860141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:04.861967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:04.932101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba812e23-1072-40b8-b5cf-c451f0f6edc9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:04.939595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:04.940294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:04.940580 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:04.941038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:04.951069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:04.958029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:04.958284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:04.958284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:04.965232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1105/2208] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:05.070286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d946945-1659-4019-990e-b80b59ee96c5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:05.070286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:05.070542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:05.070633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:05.074161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] PATH_INFO: `/v3/projects/bf4f7441dd744062a9508fd4de185a0e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:05.085835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4f7441dd744062a9508fd4de185a0e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:05.088624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:05.238238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4f7441dd744062a9508fd4de185a0e', 'request_id': 'req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.248395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4f7441dd744062a9508fd4de185a0e', 'request_id': 'req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.255756 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4f7441dd744062a9508fd4de185a0e', 'request_id': 'req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.366206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] The token cache is being invalidate because project bf4f7441dd744062a9508fd4de185a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:11:05.366929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.367829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.370728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1104/2209] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:11:04 2022] DELETE /identity/v3/projects/bf4f7441dd744062a9508fd4de185a0e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:11:05.374973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:05.402687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d434a-6272-4dda-b39c-af0c49027e43 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:05.532224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:05.532989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:05.533632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:05.534050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] PATH_INFO: `/v3/users/1e20ffce80f148f5832728dd8a1528f4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:05.536334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e20ffce80f148f5832728dd8a1528f4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:05.539353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:05.575500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:05.785390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e20ffce80f148f5832728dd8a1528f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.889038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e20ffce80f148f5832728dd8a1528f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.907505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e20ffce80f148f5832728dd8a1528f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.907505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e20ffce80f148f5832728dd8a1528f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.924619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de0b2ab0-c7f4-48a0-a963-8283696416fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e20ffce80f148f5832728dd8a1528f4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:05.949512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1106/2210] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:11:05 2022] DELETE /identity/v3/users/1e20ffce80f148f5832728dd8a1528f4 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:06.469165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:06.651096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:06.652786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:06.669455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531f8c-8781-41a7-a9d8-cbec75e62a2b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:06.790210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:06.793506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:06.793978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:06.798383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] PATH_INFO: `/v3/projects/d5fb7f343aa44ca3b80e17153b9c6692` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:06.808082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fb7f343aa44ca3b80e17153b9c6692)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:06.810576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:06.970448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fb7f343aa44ca3b80e17153b9c6692', 'request_id': 'req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:06.980801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fb7f343aa44ca3b80e17153b9c6692', 'request_id': 'req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:06.987740 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fb7f343aa44ca3b80e17153b9c6692', 'request_id': 'req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:07.059758 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] The token cache is being invalidate because project d5fb7f343aa44ca3b80e17153b9c6692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:11:07.060234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:07.064595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fde16c26-b4cf-45df-9dbb-ea84452d1a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:07.064595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1105/2211] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:11:06 2022] DELETE /identity/v3/projects/d5fb7f343aa44ca3b80e17153b9c6692 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:07.068250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb2f5-5986-4cb2-a361-fdeaff35006a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.069039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb2f5-5986-4cb2-a361-fdeaff35006a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.069473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb2f5-5986-4cb2-a361-fdeaff35006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.101955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-40cbb2f5-5986-4cb2-a361-fdeaff35006a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:07.104023 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-40cbb2f5-5986-4cb2-a361-fdeaff35006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:07.182156 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1107/2212] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:07.190378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d3013-be73-451d-86f7-d71fa7e68db0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.190972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d3013-be73-451d-86f7-d71fa7e68db0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.191254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d3013-be73-451d-86f7-d71fa7e68db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.218793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-349d3013-be73-451d-86f7-d71fa7e68db0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:07.220205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-349d3013-be73-451d-86f7-d71fa7e68db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:07.230947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1106/2213] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:07.235530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb2f5-5986-4cb2-a361-fdeaff35006a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:07.245791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb2f5-5986-4cb2-a361-fdeaff35006a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:07.252529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:07.253280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.253556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.253963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.254684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:11:07.254986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:07.256669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:07.268774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1108/2214] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:11:07.277035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d3013-be73-451d-86f7-d71fa7e68db0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:07.284175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d3013-be73-451d-86f7-d71fa7e68db0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:07.289496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:07.290261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.291339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.291724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.292507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:07.294661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:07.439199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1107/2215] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:11:07 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:11:07.443642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:07.455128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bfb43-3d12-4dea-80ab-e622486344d5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:07.530917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:07.531767 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.532044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.532314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.532973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:07.534982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:07.677706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1109/2216] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:11:07 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:11:07.682523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:07.692743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98873b0-4395-4d83-a32b-1d43934ad384 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:07.698582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:07.699200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.699482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.699750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.700397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:07.702029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:07.729510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1108/2217] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:11:07.748145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:07.758242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46233d-e61a-47b7-813a-39725431619e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:07.764289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5a8b1-793d-402c-b6e8-48afac0f02f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:07.764838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a8b1-793d-402c-b6e8-48afac0f02f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.767547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a8b1-793d-402c-b6e8-48afac0f02f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.767547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5a8b1-793d-402c-b6e8-48afac0f02f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.767547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5a8b1-793d-402c-b6e8-48afac0f02f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:07.767931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5a8b1-793d-402c-b6e8-48afac0f02f3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:07.781892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1110/2218] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:07.786309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:07.798912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bc0ea-22a2-4bc7-8516-863efc55ef21 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:07.833473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:07.834439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.838563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.839043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] PATH_INFO: `/v3/projects/e2aed124b6c44f338eb78bf705012b05/users/40319910ee934a67b8d370a6e5371093/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:07.843574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:07.879769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2aed124b6c44f338eb78bf705012b05, user_id=40319910ee934a67b8d370a6e5371093, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:07.882466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:07.984870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1109/2219] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:11:07 2022] PUT /identity/v3/projects/e2aed124b6c44f338eb78bf705012b05/users/40319910ee934a67b8d370a6e5371093/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:07.989361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef216e-cd74-4545-85f1-12a42b061091 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:07.989656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef216e-cd74-4545-85f1-12a42b061091 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:07.989968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef216e-cd74-4545-85f1-12a42b061091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:08.028371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-44ef216e-cd74-4545-85f1-12a42b061091 None None] MFA Rules not processed for user `40319910ee934a67b8d370a6e5371093`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:08.030271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-44ef216e-cd74-4545-85f1-12a42b061091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:08.146233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1111/2220] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:08.160241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:08.166944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:08.234071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91400cf-06dd-4357-b1f1-efa031f50b7d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:08.239305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:08.239970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:08.240786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:08.241231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:08.253573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:08.255080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:08.269144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1110/2221] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:08.894585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:09.029350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327eb6-6997-49ac-8c7d-4428508e062a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:09.036763 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327eb6-6997-49ac-8c7d-4428508e062a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:09.037175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327eb6-6997-49ac-8c7d-4428508e062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:09.114681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b3327eb6-6997-49ac-8c7d-4428508e062a None None] MFA Rules not processed for user `247cf94bcddb4971b7dee68ae3168237`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:09.115931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3327eb6-6997-49ac-8c7d-4428508e062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:09.229149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1112/2222] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:09.234094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:09.235642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:09.357836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b25a3d-dcdc-40a7-9a99-f5e8e0eb5e51 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:09.368132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:09.369662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:09.370091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:09.370544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:09.371421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:09.376722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:09.488428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1111/2223] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:11:09 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:11:09.493340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327eb6-6997-49ac-8c7d-4428508e062a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:09.519486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327eb6-6997-49ac-8c7d-4428508e062a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:09.633467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:09.634095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:09.634436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:09.635132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:09.636350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:09.638784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:09.750368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1113/2224] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:11:09 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:11:09.754672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:09.768959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dd64f-f180-4634-92da-6a4277b7ab19 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:09.773795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:09.774610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:09.776965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:09.777256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:09.777940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:09.779554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:09.793834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1112/2225] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:09.798609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:09.817013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1275fa6-4ba7-46a7-8754-3b45755a274c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:09.818851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:09.819535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:09.819813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:09.820087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] PATH_INFO: `/v3/projects/1262bc2084384bbbb71f391bd1d5036a/users/a88959b2d62543de9d5bb7ea63b29b80/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:09.843551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1262bc2084384bbbb71f391bd1d5036a, user_id=a88959b2d62543de9d5bb7ea63b29b80, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:09.846479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:09.953591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1114/2226] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:11:09 2022] PUT /identity/v3/projects/1262bc2084384bbbb71f391bd1d5036a/users/a88959b2d62543de9d5bb7ea63b29b80/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:11:09.957654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:09.971166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2513c8-d282-4fa8-8956-567c8016b8e7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:10.044981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae48147-e789-4e88-8351-87792355ed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:10.049088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae48147-e789-4e88-8351-87792355ed99 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:10.049088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae48147-e789-4e88-8351-87792355ed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:10.049088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae48147-e789-4e88-8351-87792355ed99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:10.049088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae48147-e789-4e88-8351-87792355ed99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:10.053879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae48147-e789-4e88-8351-87792355ed99 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:10.077364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1113/2227] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:10.082946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:10.097469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1069d4-78f1-4404-be91-fe154065774b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:10.105801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:10.107085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:10.107666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:10.108242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] PATH_INFO: `/v3/projects/1262bc2084384bbbb71f391bd1d5036a/users/a88959b2d62543de9d5bb7ea63b29b80/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:10.111820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1262bc2084384bbbb71f391bd1d5036a, user_id=a88959b2d62543de9d5bb7ea63b29b80, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:10.116785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:10.132184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1115/2228] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:11:10 2022] PUT /identity/v3/projects/1262bc2084384bbbb71f391bd1d5036a/users/a88959b2d62543de9d5bb7ea63b29b80/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:10.199123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:11.122095 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:11.550706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab0b7-0218-4cef-9204-abd22459d2cf None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:11.550950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab0b7-0218-4cef-9204-abd22459d2cf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:11.551418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab0b7-0218-4cef-9204-abd22459d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:11.598030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-659ab0b7-0218-4cef-9204-abd22459d2cf None None] MFA Rules not processed for user `a7356e1101a14bc7a7a9d0565461c318`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:11.599521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-659ab0b7-0218-4cef-9204-abd22459d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:11.699894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1114/2229] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:11.732376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:11.792624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:11.885172 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e83a8-1e15-4b3d-ad21-b97a533ecf49 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:11.909311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:11.911955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:11.912513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:11.913020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] PATH_INFO: `/v3/users/40319910ee934a67b8d370a6e5371093` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:11.922697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40319910ee934a67b8d370a6e5371093)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:11.927623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:12.234947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40319910ee934a67b8d370a6e5371093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:12.399247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:12.454756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40319910ee934a67b8d370a6e5371093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:12.470066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40319910ee934a67b8d370a6e5371093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:12.471151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40319910ee934a67b8d370a6e5371093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:12.502453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40319910ee934a67b8d370a6e5371093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:12.520255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1116/2230] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:11:11 2022] DELETE /identity/v3/users/40319910ee934a67b8d370a6e5371093 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:12.525827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:12.526354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:12.526354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:12.568309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:12.569966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:12.640288 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1115/2231] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:12.670221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:12.671719 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:12.796508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f45f-cea4-47a2-af44-e7f27841825b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:12.803840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ec8ff-f843-4fb4-8b23-1dda263a1dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:12.804769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ec8ff-f843-4fb4-8b23-1dda263a1dde service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:12.805050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ec8ff-f843-4fb4-8b23-1dda263a1dde service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:12.805467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ec8ff-f843-4fb4-8b23-1dda263a1dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:12.837208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ec8ff-f843-4fb4-8b23-1dda263a1dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:12.840245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ec8ff-f843-4fb4-8b23-1dda263a1dde service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:12.851958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1117/2232] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:13.136405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:13.553702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:13.984847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:13.988241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:14.006428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63f463-11cc-4a23-876c-7ce39fcb9b5f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:14.026849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:14.026849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:14.026849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:14.026849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] PATH_INFO: `/v3/projects/e2aed124b6c44f338eb78bf705012b05` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:14.027216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2aed124b6c44f338eb78bf705012b05)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:14.027216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:14.183679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2aed124b6c44f338eb78bf705012b05', 'request_id': 'req-a3f84277-c255-4d01-a258-0aefba5e8bcc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:14.192196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2aed124b6c44f338eb78bf705012b05', 'request_id': 'req-a3f84277-c255-4d01-a258-0aefba5e8bcc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:14.213039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2aed124b6c44f338eb78bf705012b05', 'request_id': 'req-a3f84277-c255-4d01-a258-0aefba5e8bcc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:14.358714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] The token cache is being invalidate because project e2aed124b6c44f338eb78bf705012b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:11:14.359116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:14.366062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a3f84277-c255-4d01-a258-0aefba5e8bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:14.378013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1116/2233] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:11:13 2022] DELETE /identity/v3/projects/e2aed124b6c44f338eb78bf705012b05 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:14.379788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1badcb9-26ad-4a8c-a474-086a9a5dd79e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:14.380594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1badcb9-26ad-4a8c-a474-086a9a5dd79e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:14.381046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1badcb9-26ad-4a8c-a474-086a9a5dd79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:14.442286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b1badcb9-26ad-4a8c-a474-086a9a5dd79e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:14.443716 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b1badcb9-26ad-4a8c-a474-086a9a5dd79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:14.549471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1118/2234] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:14.558164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949ed4-11c6-4fd9-b44b-ea18858da330 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:14.558448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949ed4-11c6-4fd9-b44b-ea18858da330 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:14.558888 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949ed4-11c6-4fd9-b44b-ea18858da330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:14.590610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-10949ed4-11c6-4fd9-b44b-ea18858da330 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:14.592076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-10949ed4-11c6-4fd9-b44b-ea18858da330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:14.602033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1117/2235] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:11:14.607174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1badcb9-26ad-4a8c-a474-086a9a5dd79e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:14.621567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1badcb9-26ad-4a8c-a474-086a9a5dd79e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:14.629249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:14.630067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:14.630485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:14.630837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:14.631582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:11:14.631962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:14.633697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:14.649130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1119/2236] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:11:14.654899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10949ed4-11c6-4fd9-b44b-ea18858da330 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:14.667972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10949ed4-11c6-4fd9-b44b-ea18858da330 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:14.674813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:14.675827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:14.676337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:14.677141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:14.677994 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:14.682183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:14.827323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1118/2237] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:11:14 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:11:14.831236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:14.847931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b503990-cfb1-416f-8067-59e6cbea3051 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:14.930968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:14.933923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:14.934433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:14.935402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:14.936380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:14.938660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:15.055114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1120/2238] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:11:14 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:11:15.059942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:15.087434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70fb11-5c19-4c50-9c6d-f2e5afc244bc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:15.087434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:15.109607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:15.110547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:15.113807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:15.116209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:15.122646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:15.152286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1119/2239] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:15.154039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:15.177799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cc989-f05f-4938-a7e4-3027f827774b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:15.190529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65dd92-8554-4ec2-8cb5-3429e755cae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:15.190529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65dd92-8554-4ec2-8cb5-3429e755cae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:15.190804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65dd92-8554-4ec2-8cb5-3429e755cae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:15.190891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65dd92-8554-4ec2-8cb5-3429e755cae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:15.191619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65dd92-8554-4ec2-8cb5-3429e755cae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:15.193667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65dd92-8554-4ec2-8cb5-3429e755cae6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:15.210744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:15.215519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1121/2240] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:15.219385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:15.230273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444fa7d-8401-4d89-9083-8481c2ede2c4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:15.235461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:15.236197 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:15.236503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:15.236809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] PATH_INFO: `/v3/projects/cc3c1c183ed741a1b334f2935c648ac2/users/229fccd629754c3ab59523ed088d96e7/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:15.253805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3c1c183ed741a1b334f2935c648ac2, user_id=229fccd629754c3ab59523ed088d96e7, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:15.256490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:15.372741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1120/2241] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:11:15 2022] PUT /identity/v3/projects/cc3c1c183ed741a1b334f2935c648ac2/users/229fccd629754c3ab59523ed088d96e7/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:15.377933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bac15-b17a-4991-98ff-3a8a450861cf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:15.378223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bac15-b17a-4991-98ff-3a8a450861cf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:15.378568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bac15-b17a-4991-98ff-3a8a450861cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:15.399705 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b65bac15-b17a-4991-98ff-3a8a450861cf None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:15.402667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b65bac15-b17a-4991-98ff-3a8a450861cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:15.404255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:15.501002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1122/2242] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:11:15.510906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:15.512990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:15.620566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fabec-5115-4d24-86b5-0de464dd25ea admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:15.625108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:15.625810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:15.626107 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:15.626385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:15.638538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:15.640220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:15.654613 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1121/2243] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:16.999568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:17.156407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:17.577601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932247a9-51c9-4001-ab26-5c76d318caf3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:17.577923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932247a9-51c9-4001-ab26-5c76d318caf3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:17.578195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932247a9-51c9-4001-ab26-5c76d318caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:17.629600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-932247a9-51c9-4001-ab26-5c76d318caf3 None None] MFA Rules not processed for user `229fccd629754c3ab59523ed088d96e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:17.631355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-932247a9-51c9-4001-ab26-5c76d318caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:17.738354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1123/2244] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:17.752893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:17.756053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:17.858819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b941cf4-ca95-4747-b3f8-16d4f60bd4d2 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:17.865329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:17.866207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:17.866535 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:17.867494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:17.883708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:17.886665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:17.916089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1122/2245] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:11:18.524317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:18.645659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:18.740130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:18.740626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:18.741056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:18.780276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] MFA Rules not processed for user `a88959b2d62543de9d5bb7ea63b29b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:18.783629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:18.951244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1124/2246] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:18.971863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:18.974590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:18.990352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:18.991827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:19.009875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db27e4d-71ef-4c5a-96fd-9de6a46d22c4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:19.016880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:19.017881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:19.018359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:19.018821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] PATH_INFO: `/v3/users/4f94e32e48ad4a0285af6fa0b3643ec7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:19.020308 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f94e32e48ad4a0285af6fa0b3643ec7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:19.022714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:19.108829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fd30b-5844-4f45-93d8-41e60274a348 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:19.112905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9a3f0-20f7-44f3-9657-39e297394132 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9685c8b244249b2d29f4612a3e5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:19.113590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a3f0-20f7-44f3-9657-39e297394132 service glance] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:19.114062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a3f0-20f7-44f3-9657-39e297394132 service glance] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:19.114424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a3f0-20f7-44f3-9657-39e297394132 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:19.116320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-59b9a3f0-20f7-44f3-9657-39e297394132 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:19.188397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9a3f0-20f7-44f3-9657-39e297394132 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:19.189971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9a3f0-20f7-44f3-9657-39e297394132 service glance] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:19.199779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1123/2247] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:19.247218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f94e32e48ad4a0285af6fa0b3643ec7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:19.357011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f94e32e48ad4a0285af6fa0b3643ec7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:19.364635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f94e32e48ad4a0285af6fa0b3643ec7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:19.365261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f94e32e48ad4a0285af6fa0b3643ec7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:19.378328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f94e32e48ad4a0285af6fa0b3643ec7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:19.385400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1125/2248] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:11:18 2022] DELETE /identity/v3/users/4f94e32e48ad4a0285af6fa0b3643ec7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:19.390381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416631-7854-4f64-8b08-d06c26bd78a0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:19.394704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416631-7854-4f64-8b08-d06c26bd78a0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:19.394704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416631-7854-4f64-8b08-d06c26bd78a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:19.416094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3f416631-7854-4f64-8b08-d06c26bd78a0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:19.418037 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3f416631-7854-4f64-8b08-d06c26bd78a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:19.524730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1124/2249] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:11:19.537715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:19.539274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:19.580297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eba853-e245-4b8e-80f9-34da337e51fe None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:19.580669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eba853-e245-4b8e-80f9-34da337e51fe None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:19.581022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eba853-e245-4b8e-80f9-34da337e51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:19.614110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-20eba853-e245-4b8e-80f9-34da337e51fe None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:19.614110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-20eba853-e245-4b8e-80f9-34da337e51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:19.630227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c5dc-9a14-4bbd-bfba-1fccb445264b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:19.634551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:19.636142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:19.636142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:19.636142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:19.637869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:19.650497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:19.652085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:19.680659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1126/2250] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:19.745894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1125/2251] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:19.809015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:19.811527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:19.891039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e9bab-59f4-422d-b51f-c3e8766581a6 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:19.896087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:19.896795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:19.897211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:19.898714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:19.914870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:19.918597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:19.930389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1127/2252] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:11:20.126289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021cd6d-83a3-4184-abe1-7a7bec600af1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:20.126582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021cd6d-83a3-4184-abe1-7a7bec600af1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:20.128677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021cd6d-83a3-4184-abe1-7a7bec600af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:20.180115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7021cd6d-83a3-4184-abe1-7a7bec600af1 None None] MFA Rules not processed for user `229fccd629754c3ab59523ed088d96e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:20.181399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7021cd6d-83a3-4184-abe1-7a7bec600af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:20.209534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:20.303151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1126/2253] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:20.456431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:20.622494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:20.622494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:20.642558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8b4b-f7e0-4907-8bff-0d533cc6320a service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:20.652679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:20.653236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:20.653520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:20.656327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] PATH_INFO: `/v3/projects/0a8d27b0e4294f3aabbcb9eaa00fa614` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:20.659782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8d27b0e4294f3aabbcb9eaa00fa614)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:20.661718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:20.881563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8d27b0e4294f3aabbcb9eaa00fa614', 'request_id': 'req-7c630e60-652b-44ef-b71e-49e7ba1a557d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:20.895122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8d27b0e4294f3aabbcb9eaa00fa614', 'request_id': 'req-7c630e60-652b-44ef-b71e-49e7ba1a557d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:20.906887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8d27b0e4294f3aabbcb9eaa00fa614', 'request_id': 'req-7c630e60-652b-44ef-b71e-49e7ba1a557d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:20.992471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] The token cache is being invalidate because project 0a8d27b0e4294f3aabbcb9eaa00fa614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:11:20.992814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:20.995281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c630e60-652b-44ef-b71e-49e7ba1a557d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:11:21.001188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1128/2254] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:11:20 2022] DELETE /identity/v3/projects/0a8d27b0e4294f3aabbcb9eaa00fa614 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:11:21.003043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13979e06-919f-4773-9ce6-df5ea3fe059d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:21.003564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13979e06-919f-4773-9ce6-df5ea3fe059d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:21.003900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13979e06-919f-4773-9ce6-df5ea3fe059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:21.016838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:21.054406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-13979e06-919f-4773-9ce6-df5ea3fe059d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:21.061078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-13979e06-919f-4773-9ce6-df5ea3fe059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:21.220032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1127/2255] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:21.230157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9285-57fd-48e1-864d-615716932dc7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:21.230667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9285-57fd-48e1-864d-615716932dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:21.231089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d9285-57fd-48e1-864d-615716932dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:21.362056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-892d9285-57fd-48e1-864d-615716932dc7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:21.363258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-892d9285-57fd-48e1-864d-615716932dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:21.386633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1129/2256] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:21.391591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13979e06-919f-4773-9ce6-df5ea3fe059d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:21.407080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13979e06-919f-4773-9ce6-df5ea3fe059d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:21.422309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:21.422935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:21.423216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:21.423492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:21.424147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:11:21.424449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:21.426339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:21.492228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1128/2257] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:11:21.496241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9285-57fd-48e1-864d-615716932dc7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:21.514944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d9285-57fd-48e1-864d-615716932dc7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:21.645346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:21.645346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:21.645346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:21.645346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:21.648336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:21.648336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:21.861796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1130/2258] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:11:21 2022] POST /identity/v3/projects => generated 375 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:11:22.128508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:22.149560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10094a2d-19e8-44f3-b186-821ce9c8d501 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:22.245807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:22.246151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:22.250775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:22.251263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:22.252079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:22.256100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:22.622732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:22.631652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1129/2259] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:11:22 2022] POST /identity/v3/users => generated 288 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:11:22.637379 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:22.655827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1261af-d109-4e77-819e-d3c6154bbba7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:22.666883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:22.667599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:22.667944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:22.668329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:22.669163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:22.672472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:22.693828 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1131/2260] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:22.698891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:22.714137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7dbb-3f51-49f7-8c37-e5db1200672c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:22.726576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5fcd9-8172-4527-9d1c-c97f68b9cf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:22.727384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5fcd9-8172-4527-9d1c-c97f68b9cf01 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:22.733920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5fcd9-8172-4527-9d1c-c97f68b9cf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:22.734958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5fcd9-8172-4527-9d1c-c97f68b9cf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:22.736880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5fcd9-8172-4527-9d1c-c97f68b9cf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:22.739330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5fcd9-8172-4527-9d1c-c97f68b9cf01 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:22.753915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1130/2261] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:11:22.761301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:22.778546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631150ff-7e89-42c4-b35d-6738c9aa3775 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:22.799109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:22.799788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:22.800068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:22.800343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] PATH_INFO: `/v3/projects/957b0d0dcca947ccab48dabbd47a7c11/users/4e96bfbb8e2c4e5093caeb866171cfec/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:22.824227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957b0d0dcca947ccab48dabbd47a7c11, user_id=4e96bfbb8e2c4e5093caeb866171cfec, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:22.828432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:22.960362 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee4c57-486b-4ee4-bd55-95c2533fa402 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:22.961585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee4c57-486b-4ee4-bd55-95c2533fa402 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:22.962009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee4c57-486b-4ee4-bd55-95c2533fa402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:22.978000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1132/2262] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:11:22 2022] PUT /identity/v3/projects/957b0d0dcca947ccab48dabbd47a7c11/users/4e96bfbb8e2c4e5093caeb866171cfec/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:11:23.071177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-fcee4c57-486b-4ee4-bd55-95c2533fa402 None None] MFA Rules not processed for user `4e96bfbb8e2c4e5093caeb866171cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:23.073245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fcee4c57-486b-4ee4-bd55-95c2533fa402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:23.228782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1131/2263] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:23.257661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:23.261736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:23.344479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993362a6-adc3-43f5-99d2-9b308c08b799 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:23.354256 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae02aa-529c-40a8-92ad-ce63750373f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:23.355091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae02aa-529c-40a8-92ad-ce63750373f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:23.355597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae02aa-529c-40a8-92ad-ce63750373f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:23.356152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae02aa-529c-40a8-92ad-ce63750373f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:23.375525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae02aa-529c-40a8-92ad-ce63750373f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:23.380074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae02aa-529c-40a8-92ad-ce63750373f4 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:23.407624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1133/2264] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:11:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:11:23.759807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:24.541518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:24.912669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:25.249931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:25.250434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:25.250716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:25.270496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] MFA Rules not processed for user `4e96bfbb8e2c4e5093caeb866171cfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:25.271708 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:25.279538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1132/2265] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:26.413706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:26.696096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:27.889152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:28.559389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:28.683928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:30.653015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfebb6-195c-41fd-8703-294ee657c1e2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:30.654157 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfebb6-195c-41fd-8703-294ee657c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:30.654621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfebb6-195c-41fd-8703-294ee657c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:30.686026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ccbfebb6-195c-41fd-8703-294ee657c1e2 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:30.687654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ccbfebb6-195c-41fd-8703-294ee657c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:30.858222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:30.859503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1134/2266] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:30.860130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:30.894949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:30.997122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:31.038687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4231893-e493-4feb-8472-0cebb80a3482 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:31.046499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d1c8-1633-4f61-bfef-ee215132e439 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:31.047364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d1c8-1633-4f61-bfef-ee215132e439 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:31.047855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d1c8-1633-4f61-bfef-ee215132e439 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:31.048296 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d1c8-1633-4f61-bfef-ee215132e439 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:31.059710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d1c8-1633-4f61-bfef-ee215132e439 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:31.062287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d1c8-1633-4f61-bfef-ee215132e439 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:31.096217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1133/2267] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:11:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:11:31.701916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:32.146375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:32.261687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:33.066745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:33.099504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:33.300384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:33.328657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:34.159755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:34.276413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:34.592717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a30c8-eb15-42f0-bebd-b1715b4595bd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:34.593703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a30c8-eb15-42f0-bebd-b1715b4595bd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:34.594335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a30c8-eb15-42f0-bebd-b1715b4595bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:34.635105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3a5a30c8-eb15-42f0-bebd-b1715b4595bd None None] MFA Rules not processed for user `81b68eda0eb445309b4c76ef2aeae190`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:34.638480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3a5a30c8-eb15-42f0-bebd-b1715b4595bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:34.812502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1135/2268] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:34.937095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.003256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.348843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.460895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.603393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.651271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.799841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.831991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:35.966479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:36.622567 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:37.638223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:37.781086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:38.855448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:38.945721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:39.174657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:39.197780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202d6b-fec1-454a-b0f3-6171e4da4bf8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:39.198291 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202d6b-fec1-454a-b0f3-6171e4da4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:39.198745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d202d6b-fec1-454a-b0f3-6171e4da4bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:39.232319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4d202d6b-fec1-454a-b0f3-6171e4da4bf8 None None] MFA Rules not processed for user `247cf94bcddb4971b7dee68ae3168237`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:39.234194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4d202d6b-fec1-454a-b0f3-6171e4da4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:39.316951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1134/2269] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:11:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:39.488776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:39.551683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:39.642666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:48.371163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa43d56-24a0-408b-a92c-2f35d15e2235 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:48.371762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa43d56-24a0-408b-a92c-2f35d15e2235 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:48.371762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa43d56-24a0-408b-a92c-2f35d15e2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:48.397676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0aa43d56-24a0-408b-a92c-2f35d15e2235 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:11:48.399817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0aa43d56-24a0-408b-a92c-2f35d15e2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:11:48.407462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1136/2270] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:11:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:11:48.426903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d202d6b-fec1-454a-b0f3-6171e4da4bf8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:11:48.448896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d202d6b-fec1-454a-b0f3-6171e4da4bf8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:11:48.461054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ba23b-8f95-48f3-b8a7-5f4f49a257fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:11:48.463154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba23b-8f95-48f3-b8a7-5f4f49a257fc service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:11:48.463440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba23b-8f95-48f3-b8a7-5f4f49a257fc service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:11:48.463716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ba23b-8f95-48f3-b8a7-5f4f49a257fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:11:48.472807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ba23b-8f95-48f3-b8a7-5f4f49a257fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:11:48.474441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ba23b-8f95-48f3-b8a7-5f4f49a257fc service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:11:48.484859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1135/2271] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:11:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:11:58.392691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=49 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:11:58.481277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=86 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:12:10.713686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e88b-c1c6-4de2-83ca-dc9cb4760a50 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:10.714311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e88b-c1c6-4de2-83ca-dc9cb4760a50 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:10.714311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9e88b-c1c6-4de2-83ca-dc9cb4760a50 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:10.715625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1137/2272] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:12:10.721789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd63ab-16bd-4a09-a117-af7b7a8f65aa None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:10.722339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd63ab-16bd-4a09-a117-af7b7a8f65aa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:10.722339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd63ab-16bd-4a09-a117-af7b7a8f65aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:10.755243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6edd63ab-16bd-4a09-a117-af7b7a8f65aa None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:10.769040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6edd63ab-16bd-4a09-a117-af7b7a8f65aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:10.860015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1136/2273] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:12:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:10.882969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e88b-c1c6-4de2-83ca-dc9cb4760a50 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:10.882969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-50c9e88b-c1c6-4de2-83ca-dc9cb4760a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:10.944271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9e88b-c1c6-4de2-83ca-dc9cb4760a50 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:10.948024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207252c9-84e7-438f-8804-2b247063a041 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9685c8b244249b2d29f4612a3e5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:10.948753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207252c9-84e7-438f-8804-2b247063a041 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:10.949040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207252c9-84e7-438f-8804-2b247063a041 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:10.949352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207252c9-84e7-438f-8804-2b247063a041 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:10.959779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207252c9-84e7-438f-8804-2b247063a041 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:10.961260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207252c9-84e7-438f-8804-2b247063a041 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:10.975285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1138/2274] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:11.240792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239496e3-42c8-4b78-a837-d0c2d954d8b0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.241082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239496e3-42c8-4b78-a837-d0c2d954d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.241394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239496e3-42c8-4b78-a837-d0c2d954d8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.261497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c01ae-5fec-47e0-90a0-2876b3ea7bee None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.262122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c01ae-5fec-47e0-90a0-2876b3ea7bee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.262559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c01ae-5fec-47e0-90a0-2876b3ea7bee None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.263152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-239496e3-42c8-4b78-a837-d0c2d954d8b0 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:11.264443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-239496e3-42c8-4b78-a837-d0c2d954d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:11.264605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1139/2275] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:12:11.269423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2009-2e0c-4f78-8eac-d9af146970cb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.270083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2009-2e0c-4f78-8eac-d9af146970cb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.270554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d2009-2e0c-4f78-8eac-d9af146970cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.283918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1137/2276] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:11.296937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239496e3-42c8-4b78-a837-d0c2d954d8b0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:11.314795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239496e3-42c8-4b78-a837-d0c2d954d8b0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:11.319993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:11.320722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.321006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.323217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.323961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-972d2009-2e0c-4f78-8eac-d9af146970cb None None] MFA Rules not processed for user `bf531e7741af49f091e1116ec1c6751c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:11.325824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-972d2009-2e0c-4f78-8eac-d9af146970cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:11.330981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:11.334764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:11.347440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1138/2277] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:12:11.404914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1140/2278] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:12:11.417636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:11.419059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:11.430661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd598-773d-427d-bc63-90bf7592b77c service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:11.435266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59094a17-ad0c-4d18-9816-187ba5db9ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:11.435867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094a17-ad0c-4d18-9816-187ba5db9ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.436139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094a17-ad0c-4d18-9816-187ba5db9ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.436403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59094a17-ad0c-4d18-9816-187ba5db9ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.447327 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59094a17-ad0c-4d18-9816-187ba5db9ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:11.449723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59094a17-ad0c-4d18-9816-187ba5db9ee7 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:11.458166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1139/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:11.555464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a220c1-1f2c-478f-bb75-ce49ee37408d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.555830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a220c1-1f2c-478f-bb75-ce49ee37408d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.556128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a220c1-1f2c-478f-bb75-ce49ee37408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.563228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6246-f77f-48f0-9e9a-96e5512717de None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.563547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6246-f77f-48f0-9e9a-96e5512717de None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.565969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6246-f77f-48f0-9e9a-96e5512717de None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.565969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1140/2280] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 16:12:11.572561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5928-8b76-4157-8d1d-04c9b41fe9c4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.572920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5928-8b76-4157-8d1d-04c9b41fe9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.573308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f5928-8b76-4157-8d1d-04c9b41fe9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.592515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-28a220c1-1f2c-478f-bb75-ce49ee37408d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:11.593842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-28a220c1-1f2c-478f-bb75-ce49ee37408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:11.599275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4a9f5928-8b76-4157-8d1d-04c9b41fe9c4 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:11.600779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4a9f5928-8b76-4157-8d1d-04c9b41fe9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:11.616220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1141/2281] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:12:11.628884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f5928-8b76-4157-8d1d-04c9b41fe9c4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:11.639450 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f5928-8b76-4157-8d1d-04c9b41fe9c4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:11.643248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:11.643851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.644132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.644499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.656782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:11.658283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:11.673167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1142/2282] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:11.676851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1141/2283] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:11.696959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:11.698702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:11.714942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48eff-1832-4115-a8ac-ac1cb6679448 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:11.721418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:11.722339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:11.722885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:11.723249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:11.735086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:11.737155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:11.748949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1143/2284] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:12.382096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81bd9c-d869-4c34-bdbc-8e71c41d9ccd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:12.382938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81bd9c-d869-4c34-bdbc-8e71c41d9ccd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:12.383216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81bd9c-d869-4c34-bdbc-8e71c41d9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:12.405633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-aa81bd9c-d869-4c34-bdbc-8e71c41d9ccd None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:12.406600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aa81bd9c-d869-4c34-bdbc-8e71c41d9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:12.416503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1142/2285] 10.222.0.26 () {58 vars in 967 bytes} [Mon Oct 3 16:12:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:12.432825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:12.445390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828cee-89d7-40e3-a6af-df04d20ab1d5 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:12.451902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:12.452550 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:12.452830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:12.453103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:12.462223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:12.464883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:12.478177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1144/2286] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:12:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:12:13.128036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516309d-6f93-4f2f-8910-b3df562e771f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:13.128325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516309d-6f93-4f2f-8910-b3df562e771f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:13.128603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516309d-6f93-4f2f-8910-b3df562e771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:13.148995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8516309d-6f93-4f2f-8910-b3df562e771f None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:13.150868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8516309d-6f93-4f2f-8910-b3df562e771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:13.186019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1143/2287] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:13.201690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:13.216367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe037-5c5c-49af-bf7c-c6af95171d00 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:13.227636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:13.229281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:13.229615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:13.230121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:13.239949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:13.241915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:13.251806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1145/2288] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:12:13.930124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644e99e-3f26-4cb5-b9c5-477b4f677508 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:13.930639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644e99e-3f26-4cb5-b9c5-477b4f677508 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:13.930720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644e99e-3f26-4cb5-b9c5-477b4f677508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:13.960335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0644e99e-3f26-4cb5-b9c5-477b4f677508 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:13.961754 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0644e99e-3f26-4cb5-b9c5-477b4f677508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:13.971871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1144/2289] 10.222.0.26 () {58 vars in 967 bytes} [Mon Oct 3 16:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:13.985929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:13.997557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572a69-f976-4a61-be53-a347ce664751 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:14.002659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007f9f4-6d6d-40b1-af52-a6712cb204b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:14.003273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f9f4-6d6d-40b1-af52-a6712cb204b2 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:14.003553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f9f4-6d6d-40b1-af52-a6712cb204b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:14.003826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f9f4-6d6d-40b1-af52-a6712cb204b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:14.012778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007f9f4-6d6d-40b1-af52-a6712cb204b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:14.014460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007f9f4-6d6d-40b1-af52-a6712cb204b2 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:14.023009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1146/2290] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:12:16.838147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644e99e-3f26-4cb5-b9c5-477b4f677508 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:16.849377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644e99e-3f26-4cb5-b9c5-477b4f677508 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:16.854897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:16.855542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:16.855819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:16.856091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] PATH_INFO: `/v3/users/4e96bfbb8e2c4e5093caeb866171cfec` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:16.857258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e96bfbb8e2c4e5093caeb866171cfec)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:16.859142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:16.957901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:12:17.062916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e96bfbb8e2c4e5093caeb866171cfec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.152325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e96bfbb8e2c4e5093caeb866171cfec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.160091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e96bfbb8e2c4e5093caeb866171cfec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.160819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e96bfbb8e2c4e5093caeb866171cfec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.174134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e96bfbb8e2c4e5093caeb866171cfec'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.180204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1145/2291] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:12:16 2022] DELETE /identity/v3/users/4e96bfbb8e2c4e5093caeb866171cfec => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:12:17.185425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:17.185897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:17.185990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:17.204729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:17.205971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:17.247529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:12:17.265498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1147/2292] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:17.275537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:17.277063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:17.383053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf993e6c-9de3-48b3-8d4b-72289965e0c5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:17.389682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f8904-f9a6-48d2-84f0-a45f41b07575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:17.392271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8904-f9a6-48d2-84f0-a45f41b07575 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:17.392271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8904-f9a6-48d2-84f0-a45f41b07575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:17.392271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f8904-f9a6-48d2-84f0-a45f41b07575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:17.403721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f8904-f9a6-48d2-84f0-a45f41b07575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:17.405174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f8904-f9a6-48d2-84f0-a45f41b07575 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:17.419084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1146/2293] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:17.672315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:17.673883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:17.688019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c2b4-0a79-4a7d-b6d9-956247213db4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:17.692840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:17.693471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:17.693752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:17.694057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] PATH_INFO: `/v3/projects/957b0d0dcca947ccab48dabbd47a7c11` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:17.695353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=957b0d0dcca947ccab48dabbd47a7c11)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:17.697849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:17.814725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957b0d0dcca947ccab48dabbd47a7c11', 'request_id': 'req-fa1e9546-fac4-4175-af8b-39a88ef89819'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.820917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957b0d0dcca947ccab48dabbd47a7c11', 'request_id': 'req-fa1e9546-fac4-4175-af8b-39a88ef89819'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.828684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957b0d0dcca947ccab48dabbd47a7c11', 'request_id': 'req-fa1e9546-fac4-4175-af8b-39a88ef89819'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.892870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] The token cache is being invalidate because project 957b0d0dcca947ccab48dabbd47a7c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:12:17.893250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.893903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:12:17.895500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1148/2294] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:12:17 2022] DELETE /identity/v3/projects/957b0d0dcca947ccab48dabbd47a7c11 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:12:19.004355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bc6e-2ebb-472e-99dd-3270674d664c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:19.004996 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bc6e-2ebb-472e-99dd-3270674d664c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:19.005185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4bc6e-2ebb-472e-99dd-3270674d664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:19.026997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-91a4bc6e-2ebb-472e-99dd-3270674d664c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:19.028457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-91a4bc6e-2ebb-472e-99dd-3270674d664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:19.115487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1147/2295] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:19.238269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:19.242498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:19.340240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e9546-fac4-4175-af8b-39a88ef89819 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:19.352558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:19.352558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:19.352558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:19.352558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:19.357678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:19.359306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:19.371129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1149/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:29.098882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=72,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:12:29.365733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=67,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:12:30.125044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeb947-b092-444b-ae06-fb3d4926448e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:30.125547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeb947-b092-444b-ae06-fb3d4926448e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:30.125641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeb947-b092-444b-ae06-fb3d4926448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:30.146465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-15aeb947-b092-444b-ae06-fb3d4926448e None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:30.147674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-15aeb947-b092-444b-ae06-fb3d4926448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:30.208426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1148/2297] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:30.231351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:30.232755 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:30.301618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c79a97-430d-4302-9c56-9e87f1c86083 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:30.306636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:30.307242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:30.307525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:30.307796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:30.316483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:30.318093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:30.326926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1150/2298] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:12:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:12:32.344044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:32.345344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:32.345819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:32.390205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:32.391764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:32.400787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1149/2299] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:32.420903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:32.422531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:32.441525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597363a5-0b6b-4f20-bde1-c5324b906216 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:32.449612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaad8d8-cd31-4a98-b812-c14ee069f3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:32.450644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad8d8-cd31-4a98-b812-c14ee069f3f5 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:32.451283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad8d8-cd31-4a98-b812-c14ee069f3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:32.451767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaad8d8-cd31-4a98-b812-c14ee069f3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:32.467359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaad8d8-cd31-4a98-b812-c14ee069f3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:32.469679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaad8d8-cd31-4a98-b812-c14ee069f3f5 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:32.484498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1151/2300] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:40.525539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:40.527294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:40.602529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be6a3-b2a6-4358-bdd5-dad0946940b4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:40.608238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:40.612632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:40.612632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:40.612632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:40.612632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:40.623622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:40.625211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:40.635798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1150/2301] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:42.477353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=38 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:12:46.566359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:46.567047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:46.567047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:46.587029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:46.588235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:46.596412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1152/2302] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:46.613708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:46.626633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d9dca-2452-4143-bd8c-17c14887d0d2 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:46.632234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393b1f5-493a-4bd2-af66-6550e7f2e8b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:46.632841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b1f5-493a-4bd2-af66-6550e7f2e8b6 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:46.633122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b1f5-493a-4bd2-af66-6550e7f2e8b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:46.633398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393b1f5-493a-4bd2-af66-6550e7f2e8b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:46.642457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b1f5-493a-4bd2-af66-6550e7f2e8b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:46.644249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393b1f5-493a-4bd2-af66-6550e7f2e8b6 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:46.653834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1151/2303] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:47.691893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:47.693275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:47.751574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0189a2e-ae1f-44a1-aa2e-b0483d10377b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:47.755131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:47.755733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:47.756041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:47.756311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:47.758026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:47.824924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:47.826331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:47.835717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1153/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:50.864219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f00dc-ccef-4c99-aa48-745223f3a9a7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:50.865240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f00dc-ccef-4c99-aa48-745223f3a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:50.865728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f00dc-ccef-4c99-aa48-745223f3a9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:50.908434 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-350f00dc-ccef-4c99-aa48-745223f3a9a7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:50.909838 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-350f00dc-ccef-4c99-aa48-745223f3a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:50.920549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1152/2305] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:50.951794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:50.975971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4f888-c052-40e9-b7f5-b571b0888d62 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:50.988031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:50.988877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:50.989314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:50.989856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:51.003844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:51.005518 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:51.019743 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1154/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:12:51.085700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e0da-8bea-4f73-9fe3-cde50515d787 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:51.085700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e0da-8bea-4f73-9fe3-cde50515d787 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:51.085700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339e0da-8bea-4f73-9fe3-cde50515d787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:51.111818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d339e0da-8bea-4f73-9fe3-cde50515d787 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:51.113322 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d339e0da-8bea-4f73-9fe3-cde50515d787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:51.122200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1153/2307] 10.222.0.26 () {58 vars in 967 bytes} [Mon Oct 3 16:12:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:51.153366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:51.171829 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82ea97-424d-49bc-9ac3-ea1458be6776 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:51.179478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:51.181543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:51.182638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:51.183203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:51.195000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:51.196984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:51.217410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1155/2308] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:12:55.200035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b56c-e643-4543-933a-3c2a024ddcd6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:55.200524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b56c-e643-4543-933a-3c2a024ddcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:55.200620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5b56c-e643-4543-933a-3c2a024ddcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:55.219905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-85f5b56c-e643-4543-933a-3c2a024ddcd6 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:12:55.221091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-85f5b56c-e643-4543-933a-3c2a024ddcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:12:55.229094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1154/2309] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:12:55.245112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:12:55.256646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6260c9-a0a6-459a-bd55-da271a71403c service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:12:55.262784 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490200c-e39d-414a-b042-117d887b358d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:12:55.263371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490200c-e39d-414a-b042-117d887b358d service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:12:55.263666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490200c-e39d-414a-b042-117d887b358d service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:12:55.263920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490200c-e39d-414a-b042-117d887b358d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:12:55.271848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490200c-e39d-414a-b042-117d887b358d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:12:55.273403 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490200c-e39d-414a-b042-117d887b358d service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:12:55.282648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1156/2310] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:13:02.984949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36b55f-216e-4391-a278-ad68b7590268 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:02.985455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36b55f-216e-4391-a278-ad68b7590268 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:02.985551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36b55f-216e-4391-a278-ad68b7590268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:02.992472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=76 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:13:03.004610 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2b36b55f-216e-4391-a278-ad68b7590268 None None] MFA Rules not processed for user `a7356e1101a14bc7a7a9d0565461c318`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:03.005842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2b36b55f-216e-4391-a278-ad68b7590268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:03.062049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1155/2311] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:13:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:05.278672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=71 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:13:13.054999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=24 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:13:15.327907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b7c74-0342-4d52-9a5d-726ec19de32b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:15.328408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b7c74-0342-4d52-9a5d-726ec19de32b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:15.328492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b7c74-0342-4d52-9a5d-726ec19de32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:15.351962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e86b7c74-0342-4d52-9a5d-726ec19de32b None None] MFA Rules not processed for user `229fccd629754c3ab59523ed088d96e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:15.353981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e86b7c74-0342-4d52-9a5d-726ec19de32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:15.416504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1157/2312] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:13:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:25.409446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=25 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:13:28.099554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e9a-1daf-4e11-9fa9-288c85b6053a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:28.100085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e9a-1daf-4e11-9fa9-288c85b6053a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:28.100085 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50e9a-1daf-4e11-9fa9-288c85b6053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:28.120151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-72b50e9a-1daf-4e11-9fa9-288c85b6053a None None] MFA Rules not processed for user `81b68eda0eb445309b4c76ef2aeae190`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:28.121378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-72b50e9a-1daf-4e11-9fa9-288c85b6053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:28.176854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1156/2313] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:37.303354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae442c5-f914-41fe-a5b5-f477a21f300b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:37.303929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae442c5-f914-41fe-a5b5-f477a21f300b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:37.303929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae442c5-f914-41fe-a5b5-f477a21f300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:37.324634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1ae442c5-f914-41fe-a5b5-f477a21f300b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:37.325859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1ae442c5-f914-41fe-a5b5-f477a21f300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:37.333928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1158/2314] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:37.348507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50e9a-1daf-4e11-9fa9-288c85b6053a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:13:37.361995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50e9a-1daf-4e11-9fa9-288c85b6053a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:13:37.367405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:13:37.367940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:37.368218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:37.369373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:37.377249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:13:37.378856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:13:37.387998 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1157/2315] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:13:42.793793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f6e03-0b13-491b-85ec-e188e26ed4db None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:42.794653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f6e03-0b13-491b-85ec-e188e26ed4db None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:42.794653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f6e03-0b13-491b-85ec-e188e26ed4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:42.815728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-922f6e03-0b13-491b-85ec-e188e26ed4db None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:42.817148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-922f6e03-0b13-491b-85ec-e188e26ed4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:42.827194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1159/2316] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:42.842041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:13:42.853444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e143c-c96f-409e-842d-7750cfd23ddb service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:13:42.860391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:13:42.861048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:42.861329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:42.861604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:42.872016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:13:42.872871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:13:42.882959 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1158/2317] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:13:45.721145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf02d2-4686-4607-a164-a9217605108f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:45.722001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf02d2-4686-4607-a164-a9217605108f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:45.722278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf02d2-4686-4607-a164-a9217605108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:45.742255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-97cf02d2-4686-4607-a164-a9217605108f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:45.743447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-97cf02d2-4686-4607-a164-a9217605108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:45.752503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1160/2318] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:45.767138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:13:45.779022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90ed13-c801-45ba-b6db-d3ca10448d8e service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:13:45.794433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6dc49-f5cd-49d5-811d-6ebcc003a7d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:13:45.795046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6dc49-f5cd-49d5-811d-6ebcc003a7d6 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:45.795324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6dc49-f5cd-49d5-811d-6ebcc003a7d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:45.795594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6dc49-f5cd-49d5-811d-6ebcc003a7d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:45.804407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6dc49-f5cd-49d5-811d-6ebcc003a7d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:13:45.808113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6dc49-f5cd-49d5-811d-6ebcc003a7d6 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:13:45.816708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1159/2319] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:13:47.195881 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb94fe-7170-48d2-a42e-fe786de677d4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:47.196427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb94fe-7170-48d2-a42e-fe786de677d4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:47.196427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb94fe-7170-48d2-a42e-fe786de677d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:47.215441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bedb94fe-7170-48d2-a42e-fe786de677d4 None None] MFA Rules not processed for user `47da043ec00e4b1d873267c39d0abcea`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:47.216787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bedb94fe-7170-48d2-a42e-fe786de677d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:47.276993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1161/2320] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:13:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:48.931678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b7da4-5f67-44a4-bd88-fa021cdc88bb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:48.932202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b7da4-5f67-44a4-bd88-fa021cdc88bb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:48.932301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b7da4-5f67-44a4-bd88-fa021cdc88bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:48.952842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-545b7da4-5f67-44a4-bd88-fa021cdc88bb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:48.954090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-545b7da4-5f67-44a4-bd88-fa021cdc88bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:48.962046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1160/2321] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:48.976731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb94fe-7170-48d2-a42e-fe786de677d4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:13:48.990360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb94fe-7170-48d2-a42e-fe786de677d4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:13:48.996632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:13:48.997228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:48.997507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:48.997805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:49.005906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:13:49.007519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:13:49.017871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1162/2322] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:13:53.225456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623585d-754d-4930-9f79-1b68ce448218 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:53.226019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623585d-754d-4930-9f79-1b68ce448218 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:53.226019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623585d-754d-4930-9f79-1b68ce448218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:53.234652 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=47 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:13:53.247913 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d623585d-754d-4930-9f79-1b68ce448218 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:13:53.249377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d623585d-754d-4930-9f79-1b68ce448218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:13:53.257122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1161/2323] 10.222.0.16 () {58 vars in 1016 bytes} [Mon Oct 3 16:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:13:53.272160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:13:53.284525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a72dbe-ae81-4b3f-b80d-05803f41a595 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:13:53.290052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:13:53.291235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:13:53.291509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:13:53.291786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:13:53.300153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:13:53.301794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:13:53.312152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1163/2324] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:03.307589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=46 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:03.313163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:22.736990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623585d-754d-4930-9f79-1b68ce448218 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:22.758638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623585d-754d-4930-9f79-1b68ce448218 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:22.767720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd26f0-af43-4719-b2f0-bb072238994c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:22.769454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd26f0-af43-4719-b2f0-bb072238994c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:22.769890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd26f0-af43-4719-b2f0-bb072238994c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:22.770268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd26f0-af43-4719-b2f0-bb072238994c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:22.772407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3bfd26f0-af43-4719-b2f0-bb072238994c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:22.800919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd26f0-af43-4719-b2f0-bb072238994c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:22.803425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd26f0-af43-4719-b2f0-bb072238994c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:22.816762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1162/2325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:23.987176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:23.987176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:24.002260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34950f-2228-46e5-9e84-7f44078fcf09 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:24.006452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc4529-8c1a-4b7f-bed1-9dabbc230aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:24.007093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4529-8c1a-4b7f-bed1-9dabbc230aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:24.007383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4529-8c1a-4b7f-bed1-9dabbc230aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:24.007672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc4529-8c1a-4b7f-bed1-9dabbc230aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:24.009896 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c5cc4529-8c1a-4b7f-bed1-9dabbc230aa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:24.026930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc4529-8c1a-4b7f-bed1-9dabbc230aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:24.029041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc4529-8c1a-4b7f-bed1-9dabbc230aa9 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:24.050461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1164/2326] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:28.614409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a715-0a7e-4678-a153-fa1b47692206 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:28.614925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a715-0a7e-4678-a153-fa1b47692206 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:28.614925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62a715-0a7e-4678-a153-fa1b47692206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:28.634547 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6a62a715-0a7e-4678-a153-fa1b47692206 None None] MFA Rules not processed for user `a7356e1101a14bc7a7a9d0565461c318`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:28.636027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6a62a715-0a7e-4678-a153-fa1b47692206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:28.643481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1163/2327] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:29.287272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07222129-4506-4c3b-8094-aa6d7ecdea29 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:29.288322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07222129-4506-4c3b-8094-aa6d7ecdea29 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:29.288605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07222129-4506-4c3b-8094-aa6d7ecdea29 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:29.290429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1165/2328] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:14:29.325419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3bd2-90d4-48cc-9a06-4e297676fcad None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:29.327326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3bd2-90d4-48cc-9a06-4e297676fcad None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:29.328933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3bd2-90d4-48cc-9a06-4e297676fcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:29.350843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-632a3bd2-90d4-48cc-9a06-4e297676fcad None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:29.352669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-632a3bd2-90d4-48cc-9a06-4e297676fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:29.363001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1164/2329] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:29.393672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a0fd-31d1-4c30-afa3-2e7b8040598a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:29.394015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a0fd-31d1-4c30-afa3-2e7b8040598a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:29.394338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a0fd-31d1-4c30-afa3-2e7b8040598a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:29.395844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1166/2330] 10.222.0.26 () {54 vars in 961 bytes} [Mon Oct 3 16:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:14:29.401919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4f04a-50ba-4dd2-8086-c4e0641e2660 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:29.402281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4f04a-50ba-4dd2-8086-c4e0641e2660 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:29.402652 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4f04a-50ba-4dd2-8086-c4e0641e2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:29.423926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2bc4f04a-50ba-4dd2-8086-c4e0641e2660 None None] MFA Rules not processed for user `e33f20c6985d48a0948969182d38ca08`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:29.425258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2bc4f04a-50ba-4dd2-8086-c4e0641e2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:29.434284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81a0fd-31d1-4c30-afa3-2e7b8040598a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:29.435277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1165/2331] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Oct 3 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:29.438171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ee81a0fd-31d1-4c30-afa3-2e7b8040598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:29.451699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4f04a-50ba-4dd2-8086-c4e0641e2660 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:29.458577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81a0fd-31d1-4c30-afa3-2e7b8040598a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:29.464290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4f04a-50ba-4dd2-8086-c4e0641e2660 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:29.464726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:29.465502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:29.466041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:29.466323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] PATH_INFO: `/v3/users/229fccd629754c3ab59523ed088d96e7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:29.467462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=229fccd629754c3ab59523ed088d96e7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:29.470697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:29.470874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:29.471789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:29.471789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:29.471981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:29.487906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:29.489522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:29.505794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1166/2332] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:29.659146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229fccd629754c3ab59523ed088d96e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:29.659830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229fccd629754c3ab59523ed088d96e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:29.736355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229fccd629754c3ab59523ed088d96e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:29.744304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229fccd629754c3ab59523ed088d96e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:29.757204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-754fdc08-4194-49fc-89ce-aee18af0aa1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229fccd629754c3ab59523ed088d96e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:29.763393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1167/2333] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:14:29 2022] DELETE /identity/v3/users/229fccd629754c3ab59523ed088d96e7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:30.011453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:30.025284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10be4f-39b5-4068-8dbf-282356a83b64 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:30.087533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:30.088196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.088504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.088773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] PATH_INFO: `/v3/projects/cc3c1c183ed741a1b334f2935c648ac2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.089960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3c1c183ed741a1b334f2935c648ac2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:30.091896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:30.206934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3c1c183ed741a1b334f2935c648ac2', 'request_id': 'req-c979bf0d-3cb4-4a19-a353-befe634d27e4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:30.212402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3c1c183ed741a1b334f2935c648ac2', 'request_id': 'req-c979bf0d-3cb4-4a19-a353-befe634d27e4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:30.219010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3c1c183ed741a1b334f2935c648ac2', 'request_id': 'req-c979bf0d-3cb4-4a19-a353-befe634d27e4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:30.272807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] The token cache is being invalidate because project cc3c1c183ed741a1b334f2935c648ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:14:30.273098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:30.273718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c979bf0d-3cb4-4a19-a353-befe634d27e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:30.275223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1167/2334] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:14:30 2022] DELETE /identity/v3/projects/cc3c1c183ed741a1b334f2935c648ac2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:30.281969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70f14-22bf-47fe-a2cc-e0e0f9c28686 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.281969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70f14-22bf-47fe-a2cc-e0e0f9c28686 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.282390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70f14-22bf-47fe-a2cc-e0e0f9c28686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.303406 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0fd70f14-22bf-47fe-a2cc-e0e0f9c28686 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:30.304597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0fd70f14-22bf-47fe-a2cc-e0e0f9c28686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:30.365176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1168/2335] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:30.373326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f1b3-1681-45de-aba4-48a44b4c913a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.373546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f1b3-1681-45de-aba4-48a44b4c913a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.373850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388f1b3-1681-45de-aba4-48a44b4c913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.394282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7388f1b3-1681-45de-aba4-48a44b4c913a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:30.395467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7388f1b3-1681-45de-aba4-48a44b4c913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:30.403791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1168/2336] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:30.408768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70f14-22bf-47fe-a2cc-e0e0f9c28686 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:30.418739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70f14-22bf-47fe-a2cc-e0e0f9c28686 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:30.423822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:30.424434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.424721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.425119 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.425699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:14:30.426040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:30.427648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:30.443036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1169/2337] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:14:30.447427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388f1b3-1681-45de-aba4-48a44b4c913a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:30.457872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388f1b3-1681-45de-aba4-48a44b4c913a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:30.462578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:30.463180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.463485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.463764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.464395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:30.466453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:30.585841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1169/2338] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:14:30 2022] POST /identity/v3/projects => generated 399 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:14:30.592312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:30.603257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bbb2f-614b-4c5c-9ae7-21f60b3d9af4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:30.649091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:30.663011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:30.663619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.663899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.664167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.664786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:30.666773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:30.741893 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1170/2339] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:14:30 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:14:30.746148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:30.756400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711a78-a841-4c0d-8931-f0b4aa9b065d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:30.760961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7d14-d524-4600-9507-c8c3edeb79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:30.761544 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7d14-d524-4600-9507-c8c3edeb79a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.761856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7d14-d524-4600-9507-c8c3edeb79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.762127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7d14-d524-4600-9507-c8c3edeb79a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.762790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7d14-d524-4600-9507-c8c3edeb79a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:30.764365 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7d14-d524-4600-9507-c8c3edeb79a2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:30.777526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1170/2340] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:14:30.781955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:30.797484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5073e2b-0bcf-495e-9281-f3f4aae42569 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:30.806712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:30.807287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.807699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.807882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.808879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:30.810910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:30.814200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f33912-17dd-4271-9648-16704d5a02b9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.814557 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f33912-17dd-4271-9648-16704d5a02b9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.817748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f33912-17dd-4271-9648-16704d5a02b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.822582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1171/2341] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:14:30.827548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:30.827695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:30.839168 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-41f33912-17dd-4271-9648-16704d5a02b9 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:30.846569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a9f21-bf18-4b9f-8dd5-1534fb0b7ef7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:30.846715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-41f33912-17dd-4271-9648-16704d5a02b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:30.846804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:30.847433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.847810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.848281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] PATH_INFO: `/v3/projects/14df68b0f9b44146bde3479da049ef60/users/47dad0754cde4c0a824f1a823aeaa4b2/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.864852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14df68b0f9b44146bde3479da049ef60, user_id=47dad0754cde4c0a824f1a823aeaa4b2, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:30.869076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:30.908105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1171/2342] 10.222.0.26 () {58 vars in 967 bytes} [Mon Oct 3 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:30.948234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1172/2343] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:14:30 2022] PUT /identity/v3/projects/14df68b0f9b44146bde3479da049ef60/users/47dad0754cde4c0a824f1a823aeaa4b2/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:30.960016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:30.960572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:30.961028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:30.995446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] MFA Rules not processed for user `47dad0754cde4c0a824f1a823aeaa4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:30.997053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:31.071090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:31.072920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:31.074095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1172/2344] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:31.086389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:31.087734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:31.144542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98258860-6aac-4f19-9e03-d052391569e1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:31.146033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ae8ad-4789-47c9-9d55-6dfce68d6145 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:31.148198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:31.148803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:31.149081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:31.149403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:31.151263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:31.151862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:31.152142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:31.152487 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:31.159730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:31.161231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:31.170244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1173/2345] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:31.211526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:31.213109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:31.222002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1173/2346] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:14:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:14:34.950794 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:34.954962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:35.006170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:35.017680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071c90e-d607-4cc5-906d-fbed405b01f4 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:35.021396 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e056b-617f-4c00-9150-ee25b062965f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:35.023977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e056b-617f-4c00-9150-ee25b062965f service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:35.023977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e056b-617f-4c00-9150-ee25b062965f service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:35.023977 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e056b-617f-4c00-9150-ee25b062965f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:35.024295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ac3e056b-617f-4c00-9150-ee25b062965f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:35.089237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e056b-617f-4c00-9150-ee25b062965f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:35.090722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e056b-617f-4c00-9150-ee25b062965f service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:35.100877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1174/2347] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:37.115071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:37.165943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:37.183571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7ca9f-4eda-48db-9aae-7ecff35f7caa service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:37.188671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:37.189303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:37.189585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:37.190003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] PATH_INFO: `/v3/users/47dad0754cde4c0a824f1a823aeaa4b2` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:37.191111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47dad0754cde4c0a824f1a823aeaa4b2)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:37.193031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:37.371440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dad0754cde4c0a824f1a823aeaa4b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:37.372170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dad0754cde4c0a824f1a823aeaa4b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:37.454946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dad0754cde4c0a824f1a823aeaa4b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:37.462904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dad0754cde4c0a824f1a823aeaa4b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:37.476738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dad0754cde4c0a824f1a823aeaa4b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:37.483031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1174/2348] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:14:37 2022] DELETE /identity/v3/users/47dad0754cde4c0a824f1a823aeaa4b2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:37.487590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:37.488523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:37.488820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:37.508413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:37.509606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:37.599275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1175/2349] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:14:37.619577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:37.621110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:37.740596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c788a-25a9-4c7e-ae25-26324460532d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:37.744263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:37.744891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:37.745169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:37.745439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:37.756070 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:37.757524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:37.769058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1175/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:38.325084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:38.326709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:38.339733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f6788-2fc0-4968-8a78-d41641c77a09 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:38.345237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:38.352901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:38.352901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:38.352901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] PATH_INFO: `/v3/projects/14df68b0f9b44146bde3479da049ef60` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:38.352901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14df68b0f9b44146bde3479da049ef60)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:38.352901 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:38.469215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14df68b0f9b44146bde3479da049ef60', 'request_id': 'req-aee93f21-6ae0-4736-9432-c0759060c8e6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:38.475122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14df68b0f9b44146bde3479da049ef60', 'request_id': 'req-aee93f21-6ae0-4736-9432-c0759060c8e6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:38.482304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14df68b0f9b44146bde3479da049ef60', 'request_id': 'req-aee93f21-6ae0-4736-9432-c0759060c8e6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:38.580628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] The token cache is being invalidate because project 14df68b0f9b44146bde3479da049ef60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:14:38.581301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:38.581573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:38.583082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1176/2351] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:14:38 2022] DELETE /identity/v3/projects/14df68b0f9b44146bde3479da049ef60 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:41.042631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:41.044821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:41.067788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93851d1-4865-4070-b391-1c182307228c service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:41.160664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:41.161372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:41.161839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:41.162285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:41.164895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:41.210250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:41.283815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:41.285356 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:41.296718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1176/2352] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:41.987713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:41.989872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:42.017879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:42.070159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee93f21-6ae0-4736-9432-c0759060c8e6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:42.077457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:42.078510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:42.079476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:42.079912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] PATH_INFO: `/v3/users/247cf94bcddb4971b7dee68ae3168237` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:42.081404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247cf94bcddb4971b7dee68ae3168237)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:42.083626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:42.278463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247cf94bcddb4971b7dee68ae3168237'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:42.346402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247cf94bcddb4971b7dee68ae3168237'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:42.357237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247cf94bcddb4971b7dee68ae3168237'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:42.358562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247cf94bcddb4971b7dee68ae3168237'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:42.374389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247cf94bcddb4971b7dee68ae3168237'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:42.402412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1177/2353] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:14:41 2022] DELETE /identity/v3/users/247cf94bcddb4971b7dee68ae3168237 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:42.657965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:42.689326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd6989-77dc-4ee9-8957-254ee8fb370a service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:42.826142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:42.827477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:42.827854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:42.828554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] PATH_INFO: `/v3/projects/42eb8aea35954d7d8ba6c0192cd28468` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:42.830165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] RBAC: Authorizing `identity:delete_project(project_id=42eb8aea35954d7d8ba6c0192cd28468)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:42.832307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:43.004264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42eb8aea35954d7d8ba6c0192cd28468', 'request_id': 'req-b92cc910-e81c-4498-bbbf-b591c46b216a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.011996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42eb8aea35954d7d8ba6c0192cd28468', 'request_id': 'req-b92cc910-e81c-4498-bbbf-b591c46b216a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.020622 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42eb8aea35954d7d8ba6c0192cd28468', 'request_id': 'req-b92cc910-e81c-4498-bbbf-b591c46b216a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.155063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] The token cache is being invalidate because project 42eb8aea35954d7d8ba6c0192cd28468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:14:43.155063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.155063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.158232 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1177/2354] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:14:42 2022] DELETE /identity/v3/projects/42eb8aea35954d7d8ba6c0192cd28468 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:43.162056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:43.164866 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:43.180272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a0e6-77a2-4897-b020-5fd703f331c7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:43.262452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:43.263218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:43.263649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:43.264818 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] PATH_INFO: `/v3/users/a88959b2d62543de9d5bb7ea63b29b80` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:43.266435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88959b2d62543de9d5bb7ea63b29b80)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:43.271341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:43.477994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:43.489373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88959b2d62543de9d5bb7ea63b29b80'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.597928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88959b2d62543de9d5bb7ea63b29b80'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.605846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88959b2d62543de9d5bb7ea63b29b80'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.606574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88959b2d62543de9d5bb7ea63b29b80'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.619955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88959b2d62543de9d5bb7ea63b29b80'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:43.630412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1178/2355] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:14:43 2022] DELETE /identity/v3/users/a88959b2d62543de9d5bb7ea63b29b80 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:14:43.972542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:43.974289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:43.991260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cc910-e81c-4498-bbbf-b591c46b216a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:44.053947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:44.066247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:44.067111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:44.067383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:44.067742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] PATH_INFO: `/v3/projects/1262bc2084384bbbb71f391bd1d5036a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:44.069013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1262bc2084384bbbb71f391bd1d5036a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:44.071065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:44.143128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:44.144629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:44.165053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1262bc2084384bbbb71f391bd1d5036a', 'request_id': 'req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:44.171618 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1262bc2084384bbbb71f391bd1d5036a', 'request_id': 'req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:44.177552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1262bc2084384bbbb71f391bd1d5036a', 'request_id': 'req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:44.213885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8332e8-d475-4295-8124-cb7e994501cd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:44.265188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:44.265927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:44.266212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:44.266488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:44.268213 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:44.277284 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] The token cache is being invalidate because project 1262bc2084384bbbb71f391bd1d5036a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:14:44.280546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:44.280546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:44.280546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1178/2356] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:14:43 2022] DELETE /identity/v3/projects/1262bc2084384bbbb71f391bd1d5036a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:44.349474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:44.351342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:44.365281 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1179/2357] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:44.965711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:44.967350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:44.980874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d979d-bd35-47ce-bdf8-8e71f9d4e51a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:44.987832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:44.987832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:44.987832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:44.987832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:44.989314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:45.000189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:45.001957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:45.010066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1179/2358] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:48.612272 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:48.613942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:48.629441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e2a82-1a74-4dfe-b78e-b1f5459fe3c4 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:48.634230 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:48.634888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:48.635263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:48.635552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] PATH_INFO: `/v3/users/81b68eda0eb445309b4c76ef2aeae190` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:48.636665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b68eda0eb445309b4c76ef2aeae190)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:48.638640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:48.660188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:48.840210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b68eda0eb445309b4c76ef2aeae190'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:48.918140 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b68eda0eb445309b4c76ef2aeae190'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:48.926497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b68eda0eb445309b4c76ef2aeae190'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:48.927412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b68eda0eb445309b4c76ef2aeae190'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:48.940643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e1935ac2-6249-4716-bd3a-09cc89f48046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b68eda0eb445309b4c76ef2aeae190'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:48.946994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1180/2359] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:14:48 2022] DELETE /identity/v3/users/81b68eda0eb445309b4c76ef2aeae190 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:49.252170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:49.252170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:49.263467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42c060-0f37-4c28-821b-1a09ec754685 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:49.315296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871b94-033a-492f-aaa1-90deb10050f0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.315296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871b94-033a-492f-aaa1-90deb10050f0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.315507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5871b94-033a-492f-aaa1-90deb10050f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.329125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:49.330080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.330357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.330628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] PATH_INFO: `/v3/projects/d6de144301e641fda8b458b8cebfa887` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.331832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6de144301e641fda8b458b8cebfa887)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:49.333803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:49.338200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c5871b94-033a-492f-aaa1-90deb10050f0 None None] MFA Rules not processed for user `a8e8dd3db526404ebdd61b4fa8e92d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:49.338200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c5871b94-033a-492f-aaa1-90deb10050f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:49.395105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1181/2360] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:14:49.460320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6de144301e641fda8b458b8cebfa887', 'request_id': 'req-46ab62db-0976-4a02-a669-d2c0a90726be'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:49.468947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6de144301e641fda8b458b8cebfa887', 'request_id': 'req-46ab62db-0976-4a02-a669-d2c0a90726be'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:49.474779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6de144301e641fda8b458b8cebfa887', 'request_id': 'req-46ab62db-0976-4a02-a669-d2c0a90726be'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:49.481055 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:49.575750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] The token cache is being invalidate because project d6de144301e641fda8b458b8cebfa887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:14:49.581566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:49.581566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-46ab62db-0976-4a02-a669-d2c0a90726be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:49.581566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1180/2361] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:14:49 2022] DELETE /identity/v3/projects/d6de144301e641fda8b458b8cebfa887 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:49.591158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9b7cc-a67c-4766-82ca-ee178adef0fd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.591449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9b7cc-a67c-4766-82ca-ee178adef0fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.591732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9b7cc-a67c-4766-82ca-ee178adef0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.617935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-82a9b7cc-a67c-4766-82ca-ee178adef0fd None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:49.621810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-82a9b7cc-a67c-4766-82ca-ee178adef0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:49.697741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1182/2362] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:49.707479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.707759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.708032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.730413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:49.731640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:49.741588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1181/2363] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:49.745667 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9b7cc-a67c-4766-82ca-ee178adef0fd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:49.752951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:49.754523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:49.756759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9b7cc-a67c-4766-82ca-ee178adef0fd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:49.762041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:49.762655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.762935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.764510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.764510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:14:49.771891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:49.771891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:49.783163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1183/2364] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:14:49.787753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:49.799940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8df8-e55b-4ae2-92a9-6125816f70b6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:49.805487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:49.806036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.806321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.806638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.807224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:49.809123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:49.822867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c03893-cf28-4eac-beab-3686144247b7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:49.830448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:49.831167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.831520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.831798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.833595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:49.843854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:49.845286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:49.853846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1182/2365] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:49.895137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1184/2366] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:14:49 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:14:49.896564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:49.910684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777cab-bd13-4f26-adaa-596280c54137 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:49.976833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:49.978638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:49.978638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:49.978638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:49.978953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:49.981982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.100347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1183/2367] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:14:49 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:14:50.101399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.113367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a27426-9f64-40cc-bdf2-5003b4d56754 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.120944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.120944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.120944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.120944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.121301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.122247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.123980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:50.134756 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1185/2368] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:14:50.138690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.153595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416eddb-c4a2-40ae-8e80-b4d891e6e879 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.159503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.160137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.160424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.160702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.161348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.163046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.173856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1184/2369] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:14:50.178255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.189383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13db5c-fb92-43a6-b232-f9d2f523426e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.194180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270728bd-23d7-462f-9ef3-029dcd5aac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.194845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270728bd-23d7-462f-9ef3-029dcd5aac16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.195131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270728bd-23d7-462f-9ef3-029dcd5aac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.195412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270728bd-23d7-462f-9ef3-029dcd5aac16 admin admin] PATH_INFO: `/v3/projects/ab83c376447248be9cfff4666b46530b/users/bd13b1b4233441c1a1739659d6b94f72/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.212038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270728bd-23d7-462f-9ef3-029dcd5aac16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab83c376447248be9cfff4666b46530b, user_id=bd13b1b4233441c1a1739659d6b94f72, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.214775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270728bd-23d7-462f-9ef3-029dcd5aac16 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.270694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.272737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:50.321805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1186/2370] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:14:50 2022] PUT /identity/v3/projects/ab83c376447248be9cfff4666b46530b/users/bd13b1b4233441c1a1739659d6b94f72/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:50.325318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea6cc-6e9b-4e18-9e51-5ea33d709f3c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.325612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea6cc-6e9b-4e18-9e51-5ea33d709f3c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.325927 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ea6cc-6e9b-4e18-9e51-5ea33d709f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.359363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9159f-1a83-420b-b2be-24d7f94d7fdc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.368041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6d7ea6cc-6e9b-4e18-9e51-5ea33d709f3c None None] MFA Rules not processed for user `bd13b1b4233441c1a1739659d6b94f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:50.369321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6d7ea6cc-6e9b-4e18-9e51-5ea33d709f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:50.379432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:50.458064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.458691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.458977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.459257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.461338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1187/2371] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:14:50.461847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ea6cc-6e9b-4e18-9e51-5ea33d709f3c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.461979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:50.477372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.479384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.490281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1185/2372] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:50.540104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ea6cc-6e9b-4e18-9e51-5ea33d709f3c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.544620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.545409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.545689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.545992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.546654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.548546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.630283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1188/2373] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:14:50 2022] POST /identity/v3/projects => generated 405 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:14:50.634304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.645422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1ff47-817c-4a27-a468-902d15018077 service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.711520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.712133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.712423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.712817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.713455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.715605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.790446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1186/2374] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:14:50 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:14:50.791555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.803104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91277ac-b9ee-493c-9f44-d30e97da5258 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.809410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.810059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.810346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.810676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.811791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.812939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.824511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1189/2375] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:14:50.829781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.841351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c03d7c-8444-4a32-898f-7d46f4d0318c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:50.850525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:50.851898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:50.852368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:50.852838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] PATH_INFO: `/v3/projects/dde03a072a9b4d02957904715b59c638/users/935f87a3c9f54b75a968fad0f7c7d1da/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:50.870840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde03a072a9b4d02957904715b59c638, user_id=935f87a3c9f54b75a968fad0f7c7d1da, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:50.873625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:50.956659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1187/2376] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:14:50 2022] PUT /identity/v3/projects/dde03a072a9b4d02957904715b59c638/users/935f87a3c9f54b75a968fad0f7c7d1da/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:14:50.958253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:50.974099 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb15981-e499-42a6-86e1-523c1f6cd981 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:51.005134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:51.034054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce58d7-edf4-4a3c-a8e5-5521c1c74c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:51.035144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce58d7-edf4-4a3c-a8e5-5521c1c74c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:51.035429 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce58d7-edf4-4a3c-a8e5-5521c1c74c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:51.035837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce58d7-edf4-4a3c-a8e5-5521c1c74c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:51.036627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce58d7-edf4-4a3c-a8e5-5521c1c74c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:51.038402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce58d7-edf4-4a3c-a8e5-5521c1c74c3b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:51.053634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1190/2377] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:14:51.057955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:51.073161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21d6b2-c05d-4b92-9ef3-01ebbaaabac4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:51.078773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:51.079665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:51.080004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:51.080219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] PATH_INFO: `/v3/projects/dde03a072a9b4d02957904715b59c638/users/935f87a3c9f54b75a968fad0f7c7d1da/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:51.082282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde03a072a9b4d02957904715b59c638, user_id=935f87a3c9f54b75a968fad0f7c7d1da, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:51.085365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:51.098910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1188/2378] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:14:51 2022] PUT /identity/v3/projects/dde03a072a9b4d02957904715b59c638/users/935f87a3c9f54b75a968fad0f7c7d1da/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:51.112491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8bde4-59c2-4539-90a6-8f2db56e4591 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:51.113295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8bde4-59c2-4539-90a6-8f2db56e4591 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:51.113295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8bde4-59c2-4539-90a6-8f2db56e4591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:51.146629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-89f8bde4-59c2-4539-90a6-8f2db56e4591 None None] MFA Rules not processed for user `935f87a3c9f54b75a968fad0f7c7d1da`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:51.150344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-89f8bde4-59c2-4539-90a6-8f2db56e4591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:51.225875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1191/2379] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:51 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:51.238484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:51.240187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:51.357966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ed13d-7c4d-4025-a16c-b7dd81cd3edb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:51.363511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb62156-8233-4c71-9e61-95163393f4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:51.365007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb62156-8233-4c71-9e61-95163393f4aa service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:51.365429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb62156-8233-4c71-9e61-95163393f4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:51.366280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb62156-8233-4c71-9e61-95163393f4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:51.381108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb62156-8233-4c71-9e61-95163393f4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:51.383240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb62156-8233-4c71-9e61-95163393f4aa service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:51.389219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:51.408422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1189/2380] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:51 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:51.604015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8bde4-59c2-4539-90a6-8f2db56e4591 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:51.703814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8bde4-59c2-4539-90a6-8f2db56e4591 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:51.712711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:51.713920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:51.714473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:51.716659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] PATH_INFO: `/v3/users/bd13b1b4233441c1a1739659d6b94f72` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:51.719906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd13b1b4233441c1a1739659d6b94f72)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:51.723455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:51.949138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd13b1b4233441c1a1739659d6b94f72'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:52.020777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd13b1b4233441c1a1739659d6b94f72'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:52.026623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:52.030440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd13b1b4233441c1a1739659d6b94f72'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:52.031182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd13b1b4233441c1a1739659d6b94f72'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:52.044406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd13b1b4233441c1a1739659d6b94f72'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:52.052671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1192/2381] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:14:51 2022] DELETE /identity/v3/users/bd13b1b4233441c1a1739659d6b94f72 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:52.056795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:52.057179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:52.061543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:52.084326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:52.086088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:52.132232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:52.134651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:52.190485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1190/2382] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:52.200628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:52.202465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:52.234075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d5261-4805-4158-be39-1972bbf848c1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:52.240279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:52.241110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:52.241398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:52.246290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:52.246290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:52.268472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f9736-f55e-4c86-8a46-0b1e696efd95 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:52.272260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:52.272949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:52.273304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:52.273650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:52.283965 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:52.285499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:52.297068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1191/2383] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:52.311594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:52.313415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:52.324829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1193/2384] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:52.835828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:52.837295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:52.859132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4906e-6393-4bff-9875-f30a1dbd41e2 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:52.879250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:52.880238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:52.880668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:52.881090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] PATH_INFO: `/v3/projects/ab83c376447248be9cfff4666b46530b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:52.882650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab83c376447248be9cfff4666b46530b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:52.889398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:53.034460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab83c376447248be9cfff4666b46530b', 'request_id': 'req-913816b9-2373-4da3-a983-75a5c8a33bc4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.042578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab83c376447248be9cfff4666b46530b', 'request_id': 'req-913816b9-2373-4da3-a983-75a5c8a33bc4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.050034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab83c376447248be9cfff4666b46530b', 'request_id': 'req-913816b9-2373-4da3-a983-75a5c8a33bc4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.134865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] The token cache is being invalidate because project ab83c376447248be9cfff4666b46530b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:14:53.135186 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.135831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.138387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1192/2385] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:14:52 2022] DELETE /identity/v3/projects/ab83c376447248be9cfff4666b46530b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:53.143340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:53.153697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277d2ae-0caf-4eb3-a38b-18beb71f62e3 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:53.217904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:53.218841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:53.219012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:53.219227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] PATH_INFO: `/v3/users/935f87a3c9f54b75a968fad0f7c7d1da` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:53.220358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935f87a3c9f54b75a968fad0f7c7d1da)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:53.222340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:53.237440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:53.420895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935f87a3c9f54b75a968fad0f7c7d1da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.486463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935f87a3c9f54b75a968fad0f7c7d1da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.494603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935f87a3c9f54b75a968fad0f7c7d1da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.495562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935f87a3c9f54b75a968fad0f7c7d1da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.509049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-771f1707-f8b0-4865-b514-1eb508c7be74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935f87a3c9f54b75a968fad0f7c7d1da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:53.515492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1194/2386] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:14:53 2022] DELETE /identity/v3/users/935f87a3c9f54b75a968fad0f7c7d1da => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:53.925308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:53.926845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:53.944833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913816b9-2373-4da3-a983-75a5c8a33bc4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:53.975698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:54.016635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:54.017349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.017671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.019553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] PATH_INFO: `/v3/projects/dde03a072a9b4d02957904715b59c638` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.019553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde03a072a9b4d02957904715b59c638)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:54.021477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:54.138125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde03a072a9b4d02957904715b59c638', 'request_id': 'req-a265db09-c42d-4d0d-a650-7d043d0671f8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:54.146443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde03a072a9b4d02957904715b59c638', 'request_id': 'req-a265db09-c42d-4d0d-a650-7d043d0671f8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:54.152335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde03a072a9b4d02957904715b59c638', 'request_id': 'req-a265db09-c42d-4d0d-a650-7d043d0671f8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:54.204368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] The token cache is being invalidate because project dde03a072a9b4d02957904715b59c638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:14:54.204701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:54.206169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a265db09-c42d-4d0d-a650-7d043d0671f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:14:54.206980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1193/2387] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:14:53 2022] DELETE /identity/v3/projects/dde03a072a9b4d02957904715b59c638 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:54.212026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aadc2-2b07-4d55-b2cf-ad01164dd69a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.212517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aadc2-2b07-4d55-b2cf-ad01164dd69a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.212744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aadc2-2b07-4d55-b2cf-ad01164dd69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.235703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-690aadc2-2b07-4d55-b2cf-ad01164dd69a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:54.239522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-690aadc2-2b07-4d55-b2cf-ad01164dd69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:54.303097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1195/2388] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:54.311075 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d79f5-a718-407d-8556-45431cbc3d5a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.311444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d79f5-a718-407d-8556-45431cbc3d5a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.311794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d79f5-a718-407d-8556-45431cbc3d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.333542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-039d79f5-a718-407d-8556-45431cbc3d5a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:54.335025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-039d79f5-a718-407d-8556-45431cbc3d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:54.343627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1194/2389] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:54.347914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aadc2-2b07-4d55-b2cf-ad01164dd69a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:54.359123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aadc2-2b07-4d55-b2cf-ad01164dd69a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:54.363926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:54.364538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.364821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.365096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.365755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:14:54.366094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:54.367874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:54.385391 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1196/2390] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:14:54.389189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d79f5-a718-407d-8556-45431cbc3d5a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:54.403126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d79f5-a718-407d-8556-45431cbc3d5a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:54.408841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:54.409471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.409776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.410092 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.411237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:54.413506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:54.509460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1195/2391] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:14:54 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:14:54.514087 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:54.525113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48843822-3bad-4d85-87a6-66e4c74ee235 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:54.586056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:54.586635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.586918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.587195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.587877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:54.590025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:54.721903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1197/2392] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:14:54 2022] POST /identity/v3/users => generated 282 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:14:54.723100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:54.735220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01cdf2-6c19-4c61-830f-f6c883f28e43 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:54.739857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:54.740481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.740760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.741038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.741686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:54.743374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:54.756701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1196/2393] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:14:54.760948 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:54.770936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c84e-8f64-484d-9029-9b1071e3de83 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:54.775489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:54.776082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.776363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.776696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.777337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:54.779019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:54.781573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:54.790615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1198/2394] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:14:54.794490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:54.805069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611b2e7-7c0b-4cac-9e28-619aacb611ce admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:54.809680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e817a0-686c-4371-b0a9-f852fb3760fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:54.810370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e817a0-686c-4371-b0a9-f852fb3760fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.810674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e817a0-686c-4371-b0a9-f852fb3760fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.810948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e817a0-686c-4371-b0a9-f852fb3760fd admin admin] PATH_INFO: `/v3/projects/6947a57bcdc7458d8f3261971b9a9238/users/d76dffdd893e4e1ea162f8cd3ce47143/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.826199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e817a0-686c-4371-b0a9-f852fb3760fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6947a57bcdc7458d8f3261971b9a9238, user_id=d76dffdd893e4e1ea162f8cd3ce47143, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:54.831388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e817a0-686c-4371-b0a9-f852fb3760fd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:54.849476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:54.852819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:54.935193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1197/2395] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:14:54 2022] PUT /identity/v3/projects/6947a57bcdc7458d8f3261971b9a9238/users/d76dffdd893e4e1ea162f8cd3ce47143/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:14:54.940627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f61e9-e8fc-4f94-8dd4-3c4e10aa6cc4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:54.946597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d1b7-ff7f-44bc-8d90-2515918c0f7b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:54.946966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d1b7-ff7f-44bc-8d90-2515918c0f7b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:54.948539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366d1b7-ff7f-44bc-8d90-2515918c0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:54.981732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9366d1b7-ff7f-44bc-8d90-2515918c0f7b None None] MFA Rules not processed for user `d76dffdd893e4e1ea162f8cd3ce47143`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:54.983570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9366d1b7-ff7f-44bc-8d90-2515918c0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:55.017216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.017951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.018242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.018571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.020464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:55.039603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.041743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.056047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:55.069821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1199/2396] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:14:55.089886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1198/2397] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:14:55.092869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:55.176442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71726773-0411-42d8-9f92-a86c01f3aca4 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:55.181717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.182382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.182660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.182930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.183810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.186759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.290657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1200/2398] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:14:55 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:14:55.295360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d1b7-ff7f-44bc-8d90-2515918c0f7b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:55.306140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366d1b7-ff7f-44bc-8d90-2515918c0f7b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:55.366700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.367343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.367612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.367900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.368516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.370456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.490266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1199/2399] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:14:55 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:14:55.494159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:55.505004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d49a0-8113-4811-af01-b21f829c096d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:55.509712 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.510387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.510663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.510936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.511571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.513192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.515457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:14:55.525077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1201/2400] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:14:55.529294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:55.539275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf3c6-0c3c-4d6d-99bc-d3bbb8fed8ce admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:55.544013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.544718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.545035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.545317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] PATH_INFO: `/v3/projects/4c075376644e4cd2a111470a63fadeb9/users/2d9d354fc7e44c04a4141bbfafa34063/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.560224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c075376644e4cd2a111470a63fadeb9, user_id=2d9d354fc7e44c04a4141bbfafa34063, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.563553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.660478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1200/2401] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:14:55 2022] PUT /identity/v3/projects/4c075376644e4cd2a111470a63fadeb9/users/2d9d354fc7e44c04a4141bbfafa34063/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:14:55.664438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:55.674401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a56e12-f8c8-4680-84ce-6a2039a50015 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:55.731889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fcc71-de83-416c-907e-7080f1501c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.732649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fcc71-de83-416c-907e-7080f1501c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.732935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fcc71-de83-416c-907e-7080f1501c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.733295 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fcc71-de83-416c-907e-7080f1501c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.734442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fcc71-de83-416c-907e-7080f1501c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.735639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fcc71-de83-416c-907e-7080f1501c6a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.745522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1202/2402] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:14:55.750637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:55.760597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ab14f-fbc5-426c-9a9c-7b2107d2fa2c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:55.766215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.766851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.767128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.767398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] PATH_INFO: `/v3/projects/4c075376644e4cd2a111470a63fadeb9/users/2d9d354fc7e44c04a4141bbfafa34063/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.769256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c075376644e4cd2a111470a63fadeb9, user_id=2d9d354fc7e44c04a4141bbfafa34063, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.771898 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.781848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1201/2403] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:14:55 2022] PUT /identity/v3/projects/4c075376644e4cd2a111470a63fadeb9/users/2d9d354fc7e44c04a4141bbfafa34063/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:14:55.797109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bed11-9606-4fee-93f3-e1dbf02e0a15 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.797416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bed11-9606-4fee-93f3-e1dbf02e0a15 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.797695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bed11-9606-4fee-93f3-e1dbf02e0a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.825423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9c2bed11-9606-4fee-93f3-e1dbf02e0a15 None None] MFA Rules not processed for user `2d9d354fc7e44c04a4141bbfafa34063`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:14:55.827390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9c2bed11-9606-4fee-93f3-e1dbf02e0a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:55.894656 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1203/2404] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:14:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:14:55.906110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:55.907809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:14:55.964795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5af0e8-eb7f-4f1f-9198-e4e80b3ec3a7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:55.968810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:55.969402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:55.969679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:55.969980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:55.979073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:55.980485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:55.990315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1202/2405] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:14:56.200370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bed11-9606-4fee-93f3-e1dbf02e0a15 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:14:56.210480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bed11-9606-4fee-93f3-e1dbf02e0a15 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:14:56.214131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df80579-c992-40d1-af8a-b93e891025dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:14:56.214758 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df80579-c992-40d1-af8a-b93e891025dc service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:14:56.215092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df80579-c992-40d1-af8a-b93e891025dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:14:56.215314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df80579-c992-40d1-af8a-b93e891025dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:14:56.274316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df80579-c992-40d1-af8a-b93e891025dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:14:56.275784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df80579-c992-40d1-af8a-b93e891025dc service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:14:56.287720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1204/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:14:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:04.740316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:04.780461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:04.804257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe94f-51a1-47c8-af5c-804d6801e0cf service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:04.808782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:04.809412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:04.809693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:04.810529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] PATH_INFO: `/v3/users/d76dffdd893e4e1ea162f8cd3ce47143` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:04.811663 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76dffdd893e4e1ea162f8cd3ce47143)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:04.813571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:05.005714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76dffdd893e4e1ea162f8cd3ce47143'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.006482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76dffdd893e4e1ea162f8cd3ce47143'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.094407 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76dffdd893e4e1ea162f8cd3ce47143'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.102383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76dffdd893e4e1ea162f8cd3ce47143'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.115745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76dffdd893e4e1ea162f8cd3ce47143'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.121551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1203/2407] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:04 2022] DELETE /identity/v3/users/d76dffdd893e4e1ea162f8cd3ce47143 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:05.127430 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:05.127950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:05.127950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:05.148180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:05.149360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:05.158500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:05.207826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1205/2408] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:05.218395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:05.219857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:05.276423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1b62a-8254-43cc-aef5-5550dd8b5a2a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:05.280632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:05.281268 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:05.281549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:05.281975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:05.292577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:05.294046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:05.304122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1204/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:05.724277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:05.725810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:05.741729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef66b-269d-4602-9567-f3878d22bf85 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:05.746953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:05.748390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:05.748665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:05.748934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] PATH_INFO: `/v3/projects/6947a57bcdc7458d8f3261971b9a9238` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:05.750149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6947a57bcdc7458d8f3261971b9a9238)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:05.752052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:05.854211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6947a57bcdc7458d8f3261971b9a9238', 'request_id': 'req-f42f0300-5d79-4506-ac94-b35c509bd5f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.860468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6947a57bcdc7458d8f3261971b9a9238', 'request_id': 'req-f42f0300-5d79-4506-ac94-b35c509bd5f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.866570 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6947a57bcdc7458d8f3261971b9a9238', 'request_id': 'req-f42f0300-5d79-4506-ac94-b35c509bd5f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.951442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] The token cache is being invalidate because project 6947a57bcdc7458d8f3261971b9a9238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:05.951735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.952392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:05.953883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1206/2410] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:05 2022] DELETE /identity/v3/projects/6947a57bcdc7458d8f3261971b9a9238 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:05.957953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:05.968690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eeda1-c887-4892-90e8-50a0357aad3e service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:06.023239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:06.030030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:06.030674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:06.030958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:06.031231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] PATH_INFO: `/v3/users/2d9d354fc7e44c04a4141bbfafa34063` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:06.032419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9d354fc7e44c04a4141bbfafa34063)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:06.034387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:06.285669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9d354fc7e44c04a4141bbfafa34063'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.286348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9d354fc7e44c04a4141bbfafa34063'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.356648 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9d354fc7e44c04a4141bbfafa34063'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.364339 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9d354fc7e44c04a4141bbfafa34063'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.376595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9ad50107-4612-4b98-ac72-ac4572736680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9d354fc7e44c04a4141bbfafa34063'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.382510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1205/2411] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:05 2022] DELETE /identity/v3/users/2d9d354fc7e44c04a4141bbfafa34063 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:06.758670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:06.760112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:06.775008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0300-5d79-4506-ac94-b35c509bd5f2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:06.832772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:06.833338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:06.833621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:06.833933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] PATH_INFO: `/v3/projects/4c075376644e4cd2a111470a63fadeb9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:06.835081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c075376644e4cd2a111470a63fadeb9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:06.836984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:06.917454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:06.924092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c075376644e4cd2a111470a63fadeb9', 'request_id': 'req-8345188c-e223-4244-b438-295b0a99d381'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.929529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c075376644e4cd2a111470a63fadeb9', 'request_id': 'req-8345188c-e223-4244-b438-295b0a99d381'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.936049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c075376644e4cd2a111470a63fadeb9', 'request_id': 'req-8345188c-e223-4244-b438-295b0a99d381'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.989849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] The token cache is being invalidate because project 4c075376644e4cd2a111470a63fadeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:06.990387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.991152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8345188c-e223-4244-b438-295b0a99d381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:06.993074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1207/2412] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:06 2022] DELETE /identity/v3/projects/4c075376644e4cd2a111470a63fadeb9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:06.998090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75803db-7caa-4fe0-8dce-749dc521c8ea None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:06.998557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75803db-7caa-4fe0-8dce-749dc521c8ea None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:06.998653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75803db-7caa-4fe0-8dce-749dc521c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.019060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e75803db-7caa-4fe0-8dce-749dc521c8ea None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:07.020283 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e75803db-7caa-4fe0-8dce-749dc521c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:07.083853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1206/2413] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:07.092276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf25ec-40db-4b82-8b7c-3a39b1141cb8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.092564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf25ec-40db-4b82-8b7c-3a39b1141cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.096255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf25ec-40db-4b82-8b7c-3a39b1141cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.112871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5daf25ec-40db-4b82-8b7c-3a39b1141cb8 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:07.114113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5daf25ec-40db-4b82-8b7c-3a39b1141cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:07.122048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1208/2414] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:07.126531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75803db-7caa-4fe0-8dce-749dc521c8ea None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.136663 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75803db-7caa-4fe0-8dce-749dc521c8ea None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:07.142031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:07.142704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.142989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.143268 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.143920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:15:07.144229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:07.145922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:07.159001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1207/2415] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:15:07.163376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf25ec-40db-4b82-8b7c-3a39b1141cb8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.173123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf25ec-40db-4b82-8b7c-3a39b1141cb8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:07.178055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:07.178663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.178950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.179223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.179853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:07.181802 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:07.261994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1209/2416] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:07 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:07.266681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.277687 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ace22f-03ad-4b9a-840c-15ea9c53f2bb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:07.343588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:07.344241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.344527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.344803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.345438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:07.347410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:07.359438 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:07.485419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1208/2417] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:07 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:07.488604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.499619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd6628-71e7-457b-9ed1-080eace90508 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:07.504520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:07.505121 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.505404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.505681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.506360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:07.507966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:07.520131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1210/2418] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:07.531333 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.542552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0af2e5-bd17-45fc-a08a-16c6233e1fe6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:07.552498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3ffe-0e43-4c1b-ba8c-33a52b82c1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:07.553112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3ffe-0e43-4c1b-ba8c-33a52b82c1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.553394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3ffe-0e43-4c1b-ba8c-33a52b82c1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.553670 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3ffe-0e43-4c1b-ba8c-33a52b82c1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.554342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3ffe-0e43-4c1b-ba8c-33a52b82c1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:07.556006 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3ffe-0e43-4c1b-ba8c-33a52b82c1fb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:07.568247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1209/2419] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:07.572470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.583132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8b58d-79c3-493c-9afd-b8ea5b1c5c5f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:07.588047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:07.588812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.589166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.589513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] PATH_INFO: `/v3/projects/8560a2f3aca74dcb86a9cd5a86b1a8a0/users/a13a783b71994327936380e13af469b1/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.605270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8560a2f3aca74dcb86a9cd5a86b1a8a0, user_id=a13a783b71994327936380e13af469b1, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:07.608804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:07.666456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1211/2420] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:07 2022] PUT /identity/v3/projects/8560a2f3aca74dcb86a9cd5a86b1a8a0/users/a13a783b71994327936380e13af469b1/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:07.681034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb82f-7870-44a2-8b66-c942b7107557 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.681455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb82f-7870-44a2-8b66-c942b7107557 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.681844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58eb82f-7870-44a2-8b66-c942b7107557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.710048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c58eb82f-7870-44a2-8b66-c942b7107557 None None] MFA Rules not processed for user `a13a783b71994327936380e13af469b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:07.711251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c58eb82f-7870-44a2-8b66-c942b7107557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:07.776529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1210/2421] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:07.781677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.843145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c41c4-3122-4e88-a6e9-132cb91af1f8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:07.847888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:07.848490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:07.848774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:07.849047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:07.849672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:07.851871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:07.965119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1212/2422] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:07 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:07.969863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb82f-7870-44a2-8b66-c942b7107557 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:07.980710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58eb82f-7870-44a2-8b66-c942b7107557 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:08.042336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:08.046534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.046534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.046534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.046534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:08.046534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:08.128726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1211/2423] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:07 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:08.132739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:08.143676 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac046a76-aeb6-4334-83fe-95a561f7838d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:08.149063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:08.149063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.149387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.149482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.150123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:08.151707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:08.163205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1213/2424] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:08.167506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:08.177957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea52b8e-63eb-4fac-a36f-c1b9e86a4bb9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:08.182851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:08.183580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.183930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.184214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] PATH_INFO: `/v3/projects/ea5f746acfbe42fab0156c07e968ee64/users/4e4d500cc5ca40b59a2d28fe8662c423/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.201076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5f746acfbe42fab0156c07e968ee64, user_id=4e4d500cc5ca40b59a2d28fe8662c423, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:08.203809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:08.288842 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1212/2425] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:08 2022] PUT /identity/v3/projects/ea5f746acfbe42fab0156c07e968ee64/users/4e4d500cc5ca40b59a2d28fe8662c423/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:08.292960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:08.304064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40456b9b-bcae-456a-b1a1-39f7e0d6d7d2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:08.344741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:08.364137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048b11-15a5-4caf-bede-210432645af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:08.364752 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048b11-15a5-4caf-bede-210432645af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.365040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048b11-15a5-4caf-bede-210432645af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.367956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048b11-15a5-4caf-bede-210432645af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.367956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048b11-15a5-4caf-bede-210432645af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:08.367956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048b11-15a5-4caf-bede-210432645af8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:08.381005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1214/2426] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:08.382647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:08.394003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cd1f3-1245-4b3e-b7ff-cea9b366c6fe admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:08.398726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db6020-68f5-46d2-969d-6af196e19d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:08.399391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db6020-68f5-46d2-969d-6af196e19d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.399671 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db6020-68f5-46d2-969d-6af196e19d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.399946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db6020-68f5-46d2-969d-6af196e19d8a admin admin] PATH_INFO: `/v3/projects/ea5f746acfbe42fab0156c07e968ee64/users/4e4d500cc5ca40b59a2d28fe8662c423/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.402008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db6020-68f5-46d2-969d-6af196e19d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5f746acfbe42fab0156c07e968ee64, user_id=4e4d500cc5ca40b59a2d28fe8662c423, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:08.404742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db6020-68f5-46d2-969d-6af196e19d8a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:08.415570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1213/2427] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:08 2022] PUT /identity/v3/projects/ea5f746acfbe42fab0156c07e968ee64/users/4e4d500cc5ca40b59a2d28fe8662c423/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:08.426159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.426447 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.426781 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.458293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] MFA Rules not processed for user `4e4d500cc5ca40b59a2d28fe8662c423`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:08.459732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:08.461410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.468276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.468276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.483377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:08.485235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:08.509796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:08.543820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1215/2428] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:08.555833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:08.557507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1214/2429] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:08.562249 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:08.571781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:08.573248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:08.636464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeddfe4-bc41-45c8-a5bb-d55d8f915826 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:08.640273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:08.640893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.641182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.641456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.650778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:08.652127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba7376-fea2-4990-b886-1f24296ee959 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:08.652299 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:08.657582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:08.658278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:08.658694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:08.658976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:08.662310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1216/2430] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:15:08.668746 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:08.671155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:08.679547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1215/2431] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:15:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:15:09.338679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:09.340359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:09.450460 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:09.459930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8129932-121a-4de3-8c3e-86456ae6d271 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:09.466054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e5fa-2222-42ef-a228-206caff7ac9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:09.466688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e5fa-2222-42ef-a228-206caff7ac9c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:09.467008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e5fa-2222-42ef-a228-206caff7ac9c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:09.467277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e5fa-2222-42ef-a228-206caff7ac9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:09.469155 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f9d3e5fa-2222-42ef-a228-206caff7ac9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:09.491945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e5fa-2222-42ef-a228-206caff7ac9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:09.493776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e5fa-2222-42ef-a228-206caff7ac9c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:09.506803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1217/2432] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:11.621830 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:11.691700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f3afa-4519-44bc-869a-61a8aa6895a9 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:11.696749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:11.697405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:11.697688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:11.698038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] PATH_INFO: `/v3/users/a13a783b71994327936380e13af469b1` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:11.699253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13a783b71994327936380e13af469b1)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:11.702495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:12.170761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13a783b71994327936380e13af469b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:12.171526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13a783b71994327936380e13af469b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:12.274343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13a783b71994327936380e13af469b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:12.282082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:12.285000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13a783b71994327936380e13af469b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:12.300701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13a783b71994327936380e13af469b1'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:12.313073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1216/2433] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:11 2022] DELETE /identity/v3/users/a13a783b71994327936380e13af469b1 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:12.314872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:12.315373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:12.315495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:12.336347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:12.337629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:12.412760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1218/2434] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:12.423374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:12.424939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:12.492412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441eee8-e1cf-48f1-9948-63d74cbad26d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:12.496541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:12.497492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:12.498011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:12.498452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:12.508364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:12.509820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:12.522045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1217/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:13.011019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:13.012519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:13.033409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f5a0c-3037-42fc-804a-e7c0ed9fa549 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:13.046841 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:13.047463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:13.047742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:13.048012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] PATH_INFO: `/v3/projects/8560a2f3aca74dcb86a9cd5a86b1a8a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:13.052088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8560a2f3aca74dcb86a9cd5a86b1a8a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:13.054093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:13.176183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8560a2f3aca74dcb86a9cd5a86b1a8a0', 'request_id': 'req-26c7348e-0a93-4205-ab90-aebfa0aa80f6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.188310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8560a2f3aca74dcb86a9cd5a86b1a8a0', 'request_id': 'req-26c7348e-0a93-4205-ab90-aebfa0aa80f6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.195226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8560a2f3aca74dcb86a9cd5a86b1a8a0', 'request_id': 'req-26c7348e-0a93-4205-ab90-aebfa0aa80f6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.259464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] The token cache is being invalidate because project 8560a2f3aca74dcb86a9cd5a86b1a8a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:13.259665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.260305 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.266487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1219/2436] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:13 2022] DELETE /identity/v3/projects/8560a2f3aca74dcb86a9cd5a86b1a8a0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:13.267043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:13.278038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70351c-ee96-4342-b155-1f51f5071d69 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:13.377584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:13.378431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:13.378816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:13.379206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] PATH_INFO: `/v3/users/4e4d500cc5ca40b59a2d28fe8662c423` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:13.380667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e4d500cc5ca40b59a2d28fe8662c423)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:13.384364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:13.568138 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e4d500cc5ca40b59a2d28fe8662c423'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.568822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e4d500cc5ca40b59a2d28fe8662c423'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.620754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e4d500cc5ca40b59a2d28fe8662c423'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.634878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e4d500cc5ca40b59a2d28fe8662c423'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.656324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0469e5fb-720a-4861-a8de-2a390fbf8b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e4d500cc5ca40b59a2d28fe8662c423'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:13.658921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:13.665641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1218/2437] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:13 2022] DELETE /identity/v3/users/4e4d500cc5ca40b59a2d28fe8662c423 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:15:14.088377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:14.088377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:14.112300 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7348e-0a93-4205-ab90-aebfa0aa80f6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:14.201383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:14.202669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:14.203019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:14.203367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] PATH_INFO: `/v3/projects/ea5f746acfbe42fab0156c07e968ee64` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:14.204621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5f746acfbe42fab0156c07e968ee64)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:14.206650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:14.232375 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:14.338475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5f746acfbe42fab0156c07e968ee64', 'request_id': 'req-a229d692-9611-4625-8f4a-79767302f165'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:14.345131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5f746acfbe42fab0156c07e968ee64', 'request_id': 'req-a229d692-9611-4625-8f4a-79767302f165'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:14.351972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5f746acfbe42fab0156c07e968ee64', 'request_id': 'req-a229d692-9611-4625-8f4a-79767302f165'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:14.437301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] The token cache is being invalidate because project ea5f746acfbe42fab0156c07e968ee64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:14.437832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:14.438796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a229d692-9611-4625-8f4a-79767302f165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:14.441324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1220/2438] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:14 2022] DELETE /identity/v3/projects/ea5f746acfbe42fab0156c07e968ee64 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:15:14.446349 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d37a-1e58-420d-9750-49004c289476 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:14.447202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d37a-1e58-420d-9750-49004c289476 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:14.447507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d37a-1e58-420d-9750-49004c289476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:14.473855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-99d9d37a-1e58-420d-9750-49004c289476 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:14.475290 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-99d9d37a-1e58-420d-9750-49004c289476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:14.569136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1219/2439] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:14.571086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf529f3-04f7-405a-8772-bd06d73136e2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:14.571515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf529f3-04f7-405a-8772-bd06d73136e2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:14.571929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf529f3-04f7-405a-8772-bd06d73136e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:14.599678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-aaf529f3-04f7-405a-8772-bd06d73136e2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:14.600822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aaf529f3-04f7-405a-8772-bd06d73136e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:14.610706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1221/2440] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:14.614695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9d37a-1e58-420d-9750-49004c289476 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:14.626496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9d37a-1e58-420d-9750-49004c289476 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:14.631533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:14.632149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:14.632430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:14.632705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:14.633359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:15:14.633662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:14.635293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:14.654763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1220/2441] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:15:14.660436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf529f3-04f7-405a-8772-bd06d73136e2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:14.671358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf529f3-04f7-405a-8772-bd06d73136e2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:14.676653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:14.677637 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:14.678166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:14.679495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:14.679495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:14.681536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:14.914218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1222/2442] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:14 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:14.918566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:14.929694 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2aa45b-b31e-436a-b82b-3035bfa6135e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:15.037972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:15.037972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:15.037972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:15.037972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:15.038494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:15.038494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:15.294813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1221/2443] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:14 2022] POST /identity/v3/users => generated 294 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:15.298878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:15.312330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314a9e1-960d-472f-8e9c-a57289a3add0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:15.315713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:15.316325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:15.316602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:15.316874 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:15.317520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:15.319160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:15.334955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1223/2444] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:15.341516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:15.352352 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1771fa-54fa-467f-89e0-4850019ef1b7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:15.357251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8bbce-9935-4dd7-9e36-db78641278c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:15.357899 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bbce-9935-4dd7-9e36-db78641278c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:15.358176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bbce-9935-4dd7-9e36-db78641278c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:15.358484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bbce-9935-4dd7-9e36-db78641278c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:15.359167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8bbce-9935-4dd7-9e36-db78641278c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:15.360754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8bbce-9935-4dd7-9e36-db78641278c1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:15.379478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1222/2445] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:15.383601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:15.395392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108ee9-9825-4744-b31a-6a5d406f2584 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:15.404183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:15.405057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:15.405444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:15.405786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] PATH_INFO: `/v3/projects/243623e693d74246a70f897cc06b41fd/users/7acb4a8c0be3464f868de9670f0d9e30/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:15.424433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243623e693d74246a70f897cc06b41fd, user_id=7acb4a8c0be3464f868de9670f0d9e30, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:15.427683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:15.523153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1224/2446] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:15 2022] PUT /identity/v3/projects/243623e693d74246a70f897cc06b41fd/users/7acb4a8c0be3464f868de9670f0d9e30/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:15.534508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec54b1-3cce-40a6-bd70-3e4573c8349a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:15.535047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec54b1-3cce-40a6-bd70-3e4573c8349a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:15.535153 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec54b1-3cce-40a6-bd70-3e4573c8349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:15.568180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-23ec54b1-3cce-40a6-bd70-3e4573c8349a None None] MFA Rules not processed for user `7acb4a8c0be3464f868de9670f0d9e30`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:15.569549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-23ec54b1-3cce-40a6-bd70-3e4573c8349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:15.636707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:15.647974 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1223/2447] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:15.652744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:15.736525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30423f-27f8-4e03-87db-7d32958392a2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:15.741550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:15.742211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:15.742486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:15.742769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:15.743412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:15.745649 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:15.840931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1225/2448] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:15 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:15.845417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec54b1-3cce-40a6-bd70-3e4573c8349a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:15.858100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec54b1-3cce-40a6-bd70-3e4573c8349a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:15.972875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:15.973664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:15.974041 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:15.974384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:15.975100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:15.977424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:16.195020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1224/2449] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:15 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:16.199144 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:16.210370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5bf4c-3375-42ce-96c4-7242d8a098b4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:16.215119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:16.219280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:16.219280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:16.219280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:16.219280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:16.219280 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:16.235562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1226/2450] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:16.236824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:16.248615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815e4a6-2418-4d3d-a23b-7a77ee0256a6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:16.253444 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362499e-52ca-4b6f-9170-c2edc13ae09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:16.254192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362499e-52ca-4b6f-9170-c2edc13ae09c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:16.254574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362499e-52ca-4b6f-9170-c2edc13ae09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:16.254960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362499e-52ca-4b6f-9170-c2edc13ae09c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:16.255686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362499e-52ca-4b6f-9170-c2edc13ae09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:16.257359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362499e-52ca-4b6f-9170-c2edc13ae09c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:16.269130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1225/2451] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:16.273407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:16.287159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf226a-43a1-462c-9dbd-9e74b0bf968b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:16.291905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:16.292639 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:16.292930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:16.293202 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] PATH_INFO: `/v3/projects/142e1dec88474a5c99e6aeb77c526ed0/users/bb6e754e497c47aa82404c43657d799a/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:16.308571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:16.313681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142e1dec88474a5c99e6aeb77c526ed0, user_id=bb6e754e497c47aa82404c43657d799a, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:16.316427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:16.382086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1227/2452] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:16 2022] PUT /identity/v3/projects/142e1dec88474a5c99e6aeb77c526ed0/users/bb6e754e497c47aa82404c43657d799a/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:16.393087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54d94-96fb-4593-be1e-b81ffe441b45 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:16.393350 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54d94-96fb-4593-be1e-b81ffe441b45 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:16.393624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54d94-96fb-4593-be1e-b81ffe441b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:16.449626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-eab54d94-96fb-4593-be1e-b81ffe441b45 None None] MFA Rules not processed for user `bb6e754e497c47aa82404c43657d799a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:16.451272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eab54d94-96fb-4593-be1e-b81ffe441b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:16.537388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1226/2453] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:16.541990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:16.645414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aec76-a659-4f99-881a-944e06c13d14 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:16.650577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:16.651233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:16.651508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:16.651867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:16.652851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:16.656082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:16.787078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1228/2454] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:16 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:16.791103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54d94-96fb-4593-be1e-b81ffe441b45 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:16.804139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54d94-96fb-4593-be1e-b81ffe441b45 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:16.888185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:16.889289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:16.889807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:16.890306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:16.891456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:16.894019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:16.907946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:16.981797 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1227/2455] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:16 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:16.982578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:17.009462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a2a38-9619-488d-aee0-2a0dbc83e531 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:17.020010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:17.020766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:17.021146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:17.021517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:17.022301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:17.024004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:17.041810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1229/2456] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:17.046010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:17.072079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ebc95-f081-45ac-a360-61df7e8bbdb8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:17.078081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:17.079097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:17.079480 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:17.079858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] PATH_INFO: `/v3/projects/2b773bc2f11a4882b701ddd40fd2b7f2/users/03b92c21e964455280f08ce85fda3669/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:17.113203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b773bc2f11a4882b701ddd40fd2b7f2, user_id=03b92c21e964455280f08ce85fda3669, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:17.117947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:17.220212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1228/2457] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:17 2022] PUT /identity/v3/projects/2b773bc2f11a4882b701ddd40fd2b7f2/users/03b92c21e964455280f08ce85fda3669/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:17.224348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:17.239984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76efdc1-2a73-4b38-b7c8-fe7e6406d256 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:17.346532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d180-630b-454e-9469-abf24c72a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:17.347338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d180-630b-454e-9469-abf24c72a42f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:17.347770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d180-630b-454e-9469-abf24c72a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:17.348110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d180-630b-454e-9469-abf24c72a42f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:17.348840 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142d180-630b-454e-9469-abf24c72a42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:17.354220 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142d180-630b-454e-9469-abf24c72a42f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:17.366533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1230/2458] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:17.371788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:17.388704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb5754-ad9f-419f-989e-c27b4711364b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:17.393729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:17.394483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:17.394762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:17.395060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] PATH_INFO: `/v3/projects/2b773bc2f11a4882b701ddd40fd2b7f2/users/03b92c21e964455280f08ce85fda3669/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:17.397188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b773bc2f11a4882b701ddd40fd2b7f2, user_id=03b92c21e964455280f08ce85fda3669, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:17.403760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:17.417003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1229/2459] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:17 2022] PUT /identity/v3/projects/2b773bc2f11a4882b701ddd40fd2b7f2/users/03b92c21e964455280f08ce85fda3669/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:15:17.433607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:17.433919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:17.434341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:17.470577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] MFA Rules not processed for user `03b92c21e964455280f08ce85fda3669`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:17.472184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:17.553563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:17.588575 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1231/2460] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:17.601196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:17.603177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:17.674800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e721d3-3720-4a55-b8e2-31ccb2b7237f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:17.685878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:17.686650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:17.687194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:17.687566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:17.702723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:17.704243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:17.714979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1230/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:19.106101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:19.107919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:19.121024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7a090-25a5-4c3c-a450-19a3e5fa04f8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:19.125043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:19.125646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:19.125949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:19.126222 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:19.189646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:19.191174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:19.201076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1232/2462] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:24.246973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:24.255713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1ec2d-e520-45fa-a478-caee8bd06180 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:24.259598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae63f1-0040-406d-9171-c01d3f524c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:24.260312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae63f1-0040-406d-9171-c01d3f524c6b service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:24.260604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae63f1-0040-406d-9171-c01d3f524c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:24.260880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae63f1-0040-406d-9171-c01d3f524c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:24.317924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae63f1-0040-406d-9171-c01d3f524c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:24.319366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae63f1-0040-406d-9171-c01d3f524c6b service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:24.328864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1231/2463] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:28.023524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:28.095089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8cf80-8844-4142-af03-81bb90ead612 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:28.099821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:28.100579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:28.101129 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:28.101407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] PATH_INFO: `/v3/users/7acb4a8c0be3464f868de9670f0d9e30` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:28.102569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acb4a8c0be3464f868de9670f0d9e30)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:28.104618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:28.229565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:28.230067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:28.230178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:28.249863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:28.251063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:28.300594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acb4a8c0be3464f868de9670f0d9e30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:28.310939 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1232/2464] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:15:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:15:28.322827 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:28.324188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:28.329585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:28.367975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acb4a8c0be3464f868de9670f0d9e30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:28.376376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acb4a8c0be3464f868de9670f0d9e30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:28.377090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acb4a8c0be3464f868de9670f0d9e30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:28.391117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0d867adb-3cd6-47fa-8bfb-71c70d147c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acb4a8c0be3464f868de9670f0d9e30'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:28.397522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1233/2465] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:28 2022] DELETE /identity/v3/users/7acb4a8c0be3464f868de9670f0d9e30 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:28.401899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:28.402208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:28.402466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:28.405539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01ac4c-73be-468c-b90c-aac4fb5b1a59 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:28.410420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:28.423618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:28.424816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:28.467165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:28.467710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:28.468026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:28.468287 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:28.470086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:28.485857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1234/2466] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:28.495950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:28.498001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:28.530064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:28.531730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:28.540133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1233/2467] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:15:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:15:28.570160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ee618-1c70-49ca-a64d-50295e9298ab None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:28.573801 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:28.574393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:28.574669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:28.574936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:28.583795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:28.585231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:28.595296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1235/2468] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:15:29.080720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:29.082223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:29.100779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e9c6b-e54a-4ae8-a429-a17d8ce7a9e6 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:29.111869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:29.115388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:29.115388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:29.115388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] PATH_INFO: `/v3/projects/243623e693d74246a70f897cc06b41fd` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:29.115388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243623e693d74246a70f897cc06b41fd)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:29.116689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:29.221240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:29.238585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243623e693d74246a70f897cc06b41fd', 'request_id': 'req-2dedc218-1c88-4abf-a4a0-36df6b14a242'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.246541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243623e693d74246a70f897cc06b41fd', 'request_id': 'req-2dedc218-1c88-4abf-a4a0-36df6b14a242'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.253047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243623e693d74246a70f897cc06b41fd', 'request_id': 'req-2dedc218-1c88-4abf-a4a0-36df6b14a242'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.334936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] The token cache is being invalidate because project 243623e693d74246a70f897cc06b41fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:29.334936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.334936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.334936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1234/2469] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:29 2022] DELETE /identity/v3/projects/243623e693d74246a70f897cc06b41fd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:29.337488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:29.354417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16a34b-d5af-498f-aa20-0f61924d8c29 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:29.442501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:29.443742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:29.444348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:29.444859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] PATH_INFO: `/v3/users/bb6e754e497c47aa82404c43657d799a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:29.446481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6e754e497c47aa82404c43657d799a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:29.449792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:29.676972 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6e754e497c47aa82404c43657d799a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.679255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:29.762820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6e754e497c47aa82404c43657d799a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.771427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6e754e497c47aa82404c43657d799a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.772298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6e754e497c47aa82404c43657d799a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.785741 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6e754e497c47aa82404c43657d799a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:29.792432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1236/2470] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:29 2022] DELETE /identity/v3/users/bb6e754e497c47aa82404c43657d799a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:30.221603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:30.223173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:30.249485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedc218-1c88-4abf-a4a0-36df6b14a242 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:30.333251 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:30.334043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:30.334397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:30.335038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] PATH_INFO: `/v3/projects/142e1dec88474a5c99e6aeb77c526ed0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:30.338479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=142e1dec88474a5c99e6aeb77c526ed0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:30.338479 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:30.496492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142e1dec88474a5c99e6aeb77c526ed0', 'request_id': 'req-510817ef-3dac-4eb6-aac4-a5db9c922ffc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.502591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142e1dec88474a5c99e6aeb77c526ed0', 'request_id': 'req-510817ef-3dac-4eb6-aac4-a5db9c922ffc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.508195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142e1dec88474a5c99e6aeb77c526ed0', 'request_id': 'req-510817ef-3dac-4eb6-aac4-a5db9c922ffc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.588813 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] The token cache is being invalidate because project 142e1dec88474a5c99e6aeb77c526ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:30.589169 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.590002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.592160 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1235/2471] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:30 2022] DELETE /identity/v3/projects/142e1dec88474a5c99e6aeb77c526ed0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:30.596456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:30.598084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:30.611590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2ea69-7318-4ebf-bdfd-4a22b9020a7a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:30.683233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:30.683876 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:30.684304 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:30.685106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] PATH_INFO: `/v3/users/03b92c21e964455280f08ce85fda3669` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:30.686510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b92c21e964455280f08ce85fda3669)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:30.688587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:30.868761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b92c21e964455280f08ce85fda3669'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.933493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b92c21e964455280f08ce85fda3669'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.943041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b92c21e964455280f08ce85fda3669'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.943775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b92c21e964455280f08ce85fda3669'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.957515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f334f404-e460-4a44-b438-63bf321d3edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b92c21e964455280f08ce85fda3669'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:30.963688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1237/2472] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:30 2022] DELETE /identity/v3/users/03b92c21e964455280f08ce85fda3669 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:31.404532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:31.406832 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:31.424141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510817ef-3dac-4eb6-aac4-a5db9c922ffc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:31.524227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:31.525398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:31.531626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:31.532776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] PATH_INFO: `/v3/projects/2b773bc2f11a4882b701ddd40fd2b7f2` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:31.534972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b773bc2f11a4882b701ddd40fd2b7f2)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:31.537083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:31.538844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:31.656642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b773bc2f11a4882b701ddd40fd2b7f2', 'request_id': 'req-d18164f8-bdbb-4370-945e-1c332c5608b4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:31.664980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b773bc2f11a4882b701ddd40fd2b7f2', 'request_id': 'req-d18164f8-bdbb-4370-945e-1c332c5608b4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:31.672809 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b773bc2f11a4882b701ddd40fd2b7f2', 'request_id': 'req-d18164f8-bdbb-4370-945e-1c332c5608b4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:31.764019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] The token cache is being invalidate because project 2b773bc2f11a4882b701ddd40fd2b7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:31.764869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:31.766140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d18164f8-bdbb-4370-945e-1c332c5608b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:31.768548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1236/2473] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:31 2022] DELETE /identity/v3/projects/2b773bc2f11a4882b701ddd40fd2b7f2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:31.775642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303ec1-84c5-4bb4-a268-ae7aa1bc206b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:31.776227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303ec1-84c5-4bb4-a268-ae7aa1bc206b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:31.776227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303ec1-84c5-4bb4-a268-ae7aa1bc206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:31.796540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-43303ec1-84c5-4bb4-a268-ae7aa1bc206b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:31.797750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-43303ec1-84c5-4bb4-a268-ae7aa1bc206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:31.839489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:31.861117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1238/2474] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:31.869320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c611e-af6c-4a03-997b-58308bef8e06 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:31.869682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c611e-af6c-4a03-997b-58308bef8e06 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:31.869879 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c611e-af6c-4a03-997b-58308bef8e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:31.891502 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5b2c611e-af6c-4a03-997b-58308bef8e06 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:31.892801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5b2c611e-af6c-4a03-997b-58308bef8e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:31.901563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1237/2475] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:31.905918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43303ec1-84c5-4bb4-a268-ae7aa1bc206b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:31.916591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43303ec1-84c5-4bb4-a268-ae7aa1bc206b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:31.922387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:31.923040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:31.923323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:31.923604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:31.924262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:15:31.924568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:31.926405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:31.941236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1239/2476] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:15:31.945908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c611e-af6c-4a03-997b-58308bef8e06 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:31.955816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c611e-af6c-4a03-997b-58308bef8e06 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:31.960574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:31.961215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:31.961495 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:31.961781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:31.962426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:31.964312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:32.062525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1238/2477] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:31 2022] POST /identity/v3/projects => generated 401 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:32.067612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:32.079648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15f360-7c52-4a54-956e-fa0ee0cdbd49 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:32.149059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:32.149736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:32.150046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:32.150315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:32.150975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:32.152902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:32.237231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1240/2478] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:32 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:32.242188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:32.253474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d254-2b28-40eb-a503-38f11af98e55 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:32.258289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:32.258905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:32.259192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:32.264154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:32.264860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:32.266538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:32.277391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1239/2479] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:32.281777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:32.294775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e4fed-5a78-4ff2-887b-28cf3dc17acc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:32.299771 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5e4be-adf9-418e-8c8f-ab5d6c066c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:32.300489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e4be-adf9-418e-8c8f-ab5d6c066c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:32.300870 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e4be-adf9-418e-8c8f-ab5d6c066c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:32.301240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5e4be-adf9-418e-8c8f-ab5d6c066c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:32.302048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5e4be-adf9-418e-8c8f-ab5d6c066c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:32.303749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5e4be-adf9-418e-8c8f-ab5d6c066c89 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:32.316189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1241/2480] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:32.320713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:32.333646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a638-12e7-4dc1-b0bf-7a1158e8ad5a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:32.338490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:32.339155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:32.339433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:32.339706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] PATH_INFO: `/v3/projects/fde6c954a3d0482abf381ff0fe466c70/users/a36a2836f2d8496d944fc126edaf73cc/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:32.361866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde6c954a3d0482abf381ff0fe466c70, user_id=a36a2836f2d8496d944fc126edaf73cc, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:32.364531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:32.466566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1240/2481] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:32 2022] PUT /identity/v3/projects/fde6c954a3d0482abf381ff0fe466c70/users/a36a2836f2d8496d944fc126edaf73cc/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:32.478899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370eec-2430-4e1f-b161-023fd20e8284 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:32.479190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370eec-2430-4e1f-b161-023fd20e8284 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:32.479467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370eec-2430-4e1f-b161-023fd20e8284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:32.509145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d5370eec-2430-4e1f-b161-023fd20e8284 None None] MFA Rules not processed for user `a36a2836f2d8496d944fc126edaf73cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:32.510367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d5370eec-2430-4e1f-b161-023fd20e8284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:32.584470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1242/2482] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:32.589187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:32.659591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a7f1f-fa6e-4394-8501-76bd156e8463 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:32.664247 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:32.665058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:32.665344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:32.665727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:32.666612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:32.669668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:32.779066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1241/2483] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:32 2022] POST /identity/v3/projects => generated 399 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:32.779312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370eec-2430-4e1f-b161-023fd20e8284 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:32.788373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370eec-2430-4e1f-b161-023fd20e8284 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:32.866056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:32.907832 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:32.909201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:32.909504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:32.910290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:32.911464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:32.914011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:32.983228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1243/2484] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:32 2022] POST /identity/v3/users => generated 306 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:32.986565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:32.999410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d1c03-2f28-474a-a092-fd379b26cdeb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:33.004171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:33.004766 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:33.005050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:33.005325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:33.006003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:33.007649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:33.014316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:33.020761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1242/2485] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:33.025112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:33.037402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa99c-9689-4b79-be4a-3a02feea9595 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:33.042341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:33.043010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:33.043321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:33.043630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] PATH_INFO: `/v3/projects/b99826d3cd5345dfb5bdb19893d2923c/users/2407c80a76d04012baf8908dbcfd7b66/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:33.063019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99826d3cd5345dfb5bdb19893d2923c, user_id=2407c80a76d04012baf8908dbcfd7b66, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:33.066451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:33.162524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1244/2486] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:33 2022] PUT /identity/v3/projects/b99826d3cd5345dfb5bdb19893d2923c/users/2407c80a76d04012baf8908dbcfd7b66/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:33.166604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:33.178212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143095b9-a7fe-4353-83e3-0eb0e7f5ec78 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:33.248591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df73da3-055e-4f2a-b44c-8bb7c3bdfd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:33.249303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73da3-055e-4f2a-b44c-8bb7c3bdfd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:33.249595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73da3-055e-4f2a-b44c-8bb7c3bdfd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:33.249907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73da3-055e-4f2a-b44c-8bb7c3bdfd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:33.250559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df73da3-055e-4f2a-b44c-8bb7c3bdfd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:33.252199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df73da3-055e-4f2a-b44c-8bb7c3bdfd24 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:33.266368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1243/2487] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:33.267687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:33.279545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509526a9-2e99-41b2-b408-7fbcc587fe81 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:33.284917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:33.285976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:33.286134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:33.286417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] PATH_INFO: `/v3/projects/b99826d3cd5345dfb5bdb19893d2923c/users/2407c80a76d04012baf8908dbcfd7b66/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:33.288773 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99826d3cd5345dfb5bdb19893d2923c, user_id=2407c80a76d04012baf8908dbcfd7b66, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:33.291810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:33.303864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1245/2488] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:33 2022] PUT /identity/v3/projects/b99826d3cd5345dfb5bdb19893d2923c/users/2407c80a76d04012baf8908dbcfd7b66/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:33.370717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20c15-3162-4403-97e0-2ed01c3615f1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:33.371013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20c15-3162-4403-97e0-2ed01c3615f1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:33.371295 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20c15-3162-4403-97e0-2ed01c3615f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:33.402656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-05f20c15-3162-4403-97e0-2ed01c3615f1 None None] MFA Rules not processed for user `2407c80a76d04012baf8908dbcfd7b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:33.404612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-05f20c15-3162-4403-97e0-2ed01c3615f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:33.483109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1244/2489] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:33.494749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:33.496511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:33.567700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c18b8d-c7c7-4b6a-996d-b75237d8d25d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:33.571492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:33.572179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:33.572373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:33.572642 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:33.583170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:33.584613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:33.595551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1246/2490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:33.790272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20c15-3162-4403-97e0-2ed01c3615f1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:33.801697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20c15-3162-4403-97e0-2ed01c3615f1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:33.805280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8ef71-33ea-4d15-8f10-d0d87805e2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:33.805930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8ef71-33ea-4d15-8f10-d0d87805e2fe service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:33.806214 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8ef71-33ea-4d15-8f10-d0d87805e2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:33.806491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8ef71-33ea-4d15-8f10-d0d87805e2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:33.868942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8ef71-33ea-4d15-8f10-d0d87805e2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:33.870959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8ef71-33ea-4d15-8f10-d0d87805e2fe service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:33.880886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1245/2491] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:39.147653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:39.212533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1623-ff01-4a4b-b746-97f66113c840 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:39.217980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:39.218619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:39.218904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:39.219182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] PATH_INFO: `/v3/users/a36a2836f2d8496d944fc126edaf73cc` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:39.220317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36a2836f2d8496d944fc126edaf73cc)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:39.222285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:39.416581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:39.427031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36a2836f2d8496d944fc126edaf73cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:39.476581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36a2836f2d8496d944fc126edaf73cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:39.484753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36a2836f2d8496d944fc126edaf73cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:39.489128 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36a2836f2d8496d944fc126edaf73cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:39.497970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36a2836f2d8496d944fc126edaf73cc'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:39.504005 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1247/2492] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:39 2022] DELETE /identity/v3/users/a36a2836f2d8496d944fc126edaf73cc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:39.512945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:39.512945 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:39.513948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:39.532682 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:39.534189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:39.546400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:39.594940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1246/2493] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:39.605155 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:39.608946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:39.666883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa63812-e5ae-46ef-b0b7-fe4955f48dae admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:39.671389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:39.671992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:39.672275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:39.672549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:39.681486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:39.683011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:39.693271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1248/2494] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:40.269384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:40.269384 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:40.280541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc07036-3caa-453c-9d05-28596b6e11e7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:40.286013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:40.286758 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:40.287116 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:40.287395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] PATH_INFO: `/v3/projects/fde6c954a3d0482abf381ff0fe466c70` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:40.288534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde6c954a3d0482abf381ff0fe466c70)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:40.290886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:40.375545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:40.376986 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:40.437018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71987c-0f0b-4766-95e3-8817cb1dd919 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:40.444372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde6c954a3d0482abf381ff0fe466c70', 'request_id': 'req-9008e30f-1fc5-4d59-bf79-fbf80889dc92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:40.451123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde6c954a3d0482abf381ff0fe466c70', 'request_id': 'req-9008e30f-1fc5-4d59-bf79-fbf80889dc92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:40.457611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde6c954a3d0482abf381ff0fe466c70', 'request_id': 'req-9008e30f-1fc5-4d59-bf79-fbf80889dc92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:40.491401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:40.492059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:40.492344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:40.492622 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:40.494471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:40.523383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:40.556891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:40.558500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:40.567598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1249/2495] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:40.630102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] The token cache is being invalidate because project fde6c954a3d0482abf381ff0fe466c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:40.633718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:40.633718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:40.633718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1247/2496] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:40 2022] DELETE /identity/v3/projects/fde6c954a3d0482abf381ff0fe466c70 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:40.636540 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:40.706777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32a456-bf88-4779-83c3-8094f16af892 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:40.715668 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:40.716645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:40.716934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:40.717258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] PATH_INFO: `/v3/users/2407c80a76d04012baf8908dbcfd7b66` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:40.718499 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2407c80a76d04012baf8908dbcfd7b66)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:40.720459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:41.689824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2407c80a76d04012baf8908dbcfd7b66'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:41.779568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2407c80a76d04012baf8908dbcfd7b66'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:41.788886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2407c80a76d04012baf8908dbcfd7b66'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:41.796825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2407c80a76d04012baf8908dbcfd7b66'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:41.804882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b23ecbce-6570-46d4-a68c-1fd839b4da5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2407c80a76d04012baf8908dbcfd7b66'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:41.812884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1250/2497] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:40 2022] DELETE /identity/v3/users/2407c80a76d04012baf8908dbcfd7b66 => generated 0 bytes in 1177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:42.260602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:42.262100 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:42.275552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008e30f-1fc5-4d59-bf79-fbf80889dc92 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:42.338302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:42.338935 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:42.339213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:42.339514 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] PATH_INFO: `/v3/projects/b99826d3cd5345dfb5bdb19893d2923c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:42.340626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99826d3cd5345dfb5bdb19893d2923c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:42.343243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:42.487545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:42.490654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99826d3cd5345dfb5bdb19893d2923c', 'request_id': 'req-4672405d-4401-4903-9d8b-f880e59c61f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:42.499195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99826d3cd5345dfb5bdb19893d2923c', 'request_id': 'req-4672405d-4401-4903-9d8b-f880e59c61f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:42.506171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99826d3cd5345dfb5bdb19893d2923c', 'request_id': 'req-4672405d-4401-4903-9d8b-f880e59c61f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:42.599910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] The token cache is being invalidate because project b99826d3cd5345dfb5bdb19893d2923c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:42.600205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:42.601278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4672405d-4401-4903-9d8b-f880e59c61f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:42.602800 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1248/2498] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:42 2022] DELETE /identity/v3/projects/b99826d3cd5345dfb5bdb19893d2923c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:42.607956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722bff6-7d2f-4521-8929-ea7c549b1cfb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:42.613419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722bff6-7d2f-4521-8929-ea7c549b1cfb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:42.613419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722bff6-7d2f-4521-8929-ea7c549b1cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:42.630307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4722bff6-7d2f-4521-8929-ea7c549b1cfb None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:42.634746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4722bff6-7d2f-4521-8929-ea7c549b1cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:42.673845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:42.691887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1251/2499] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:42.699629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b545-2e40-4142-8fb5-4a12e3338411 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:42.699919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b545-2e40-4142-8fb5-4a12e3338411 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:42.700194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b545-2e40-4142-8fb5-4a12e3338411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:42.723468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c362b545-2e40-4142-8fb5-4a12e3338411 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:42.724835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c362b545-2e40-4142-8fb5-4a12e3338411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:42.733849 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1249/2500] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:42.738007 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722bff6-7d2f-4521-8929-ea7c549b1cfb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:42.748659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722bff6-7d2f-4521-8929-ea7c549b1cfb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:42.753686 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:42.754386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:42.754851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:42.754974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:42.755626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:15:42.756019 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:42.757614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:42.770353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1252/2501] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:15:42.774969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b545-2e40-4142-8fb5-4a12e3338411 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:42.784402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b545-2e40-4142-8fb5-4a12e3338411 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:42.789110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:42.789967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:42.790104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:42.790276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:42.790907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:42.792805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:42.880334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1250/2502] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:42 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:42.885039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:42.896367 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735881-c376-4e93-91c4-bb41179497b3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:42.955956 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:42.956571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:42.956854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:42.957130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:42.957779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:42.959708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:43.041351 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1253/2503] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:42 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:43.046113 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:43.056568 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892302ca-8b65-4737-aa28-0a8e2b2184ef admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:43.061905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:43.062501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.066713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.066713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.066713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:43.066713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:43.075673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1251/2504] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:43.084751 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:43.094581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a951933-aba5-40fd-bc1c-82457e481226 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:43.099211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183272af-5f87-461a-bbd3-a3874c770d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:43.099797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183272af-5f87-461a-bbd3-a3874c770d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.100076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183272af-5f87-461a-bbd3-a3874c770d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.100346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183272af-5f87-461a-bbd3-a3874c770d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.101240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183272af-5f87-461a-bbd3-a3874c770d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:43.102849 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183272af-5f87-461a-bbd3-a3874c770d63 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:43.113805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1254/2505] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:43.117855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:43.128681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07442da-5cbe-4183-9891-32bffc309816 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:43.133213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a520df-6a7f-4ceb-b33a-1392a838331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:43.133916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a520df-6a7f-4ceb-b33a-1392a838331c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.134195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a520df-6a7f-4ceb-b33a-1392a838331c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.134467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a520df-6a7f-4ceb-b33a-1392a838331c admin admin] PATH_INFO: `/v3/projects/b87117dbfc414cb4ab38b9206288c90e/users/e929ebcc14b646129454b8fa019b5eae/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.149112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a520df-6a7f-4ceb-b33a-1392a838331c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87117dbfc414cb4ab38b9206288c90e, user_id=e929ebcc14b646129454b8fa019b5eae, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:43.151775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a520df-6a7f-4ceb-b33a-1392a838331c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:43.221003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.225476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.225476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.248530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1252/2506] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:43 2022] PUT /identity/v3/projects/b87117dbfc414cb4ab38b9206288c90e/users/e929ebcc14b646129454b8fa019b5eae/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:43.249036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:43.250479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:43.259836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.260123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.265146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.289918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] MFA Rules not processed for user `e929ebcc14b646129454b8fa019b5eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:43.291123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:43.311868 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1255/2507] 10.222.0.26 () {58 vars in 967 bytes} [Mon Oct 3 16:15:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:15:43.340063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:43.341580 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:43.374207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1253/2508] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:15:43.383525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:43.384977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:43.402292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:43.418370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c61aec-d1d5-4b2f-9740-0dfc5843fa79 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:43.425006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:43.425878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.426169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.426487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.436066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:43.437791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:43.449503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1256/2509] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 16:15:43.450257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71eb74-948e-4a3e-986e-de6a878f6ebc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:43.451816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55763f-2fe8-4bbf-8b7c-e68b9e134eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:43.452517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55763f-2fe8-4bbf-8b7c-e68b9e134eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.452866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55763f-2fe8-4bbf-8b7c-e68b9e134eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.453146 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55763f-2fe8-4bbf-8b7c-e68b9e134eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.463793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55763f-2fe8-4bbf-8b7c-e68b9e134eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:43.466781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55763f-2fe8-4bbf-8b7c-e68b9e134eb2 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:43.479398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1254/2510] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:15:43.507485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:43.573708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f98bd-bac5-4e62-b23a-6f5841b5dc1d service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:43.578770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:43.579682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.580037 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.580380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] PATH_INFO: `/v3/users/e929ebcc14b646129454b8fa019b5eae` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.581661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e929ebcc14b646129454b8fa019b5eae)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:43.583627 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:43.768993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e929ebcc14b646129454b8fa019b5eae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:43.843803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e929ebcc14b646129454b8fa019b5eae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:43.853204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e929ebcc14b646129454b8fa019b5eae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:43.863119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e929ebcc14b646129454b8fa019b5eae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:43.881371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e929ebcc14b646129454b8fa019b5eae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:43.892340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1257/2511] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:43 2022] DELETE /identity/v3/users/e929ebcc14b646129454b8fa019b5eae => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:43.896773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a616ff-7292-418a-831e-814e496817a0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:43.898796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a616ff-7292-418a-831e-814e496817a0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:43.898796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a616ff-7292-418a-831e-814e496817a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:43.905980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:43.932983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-23a616ff-7292-418a-831e-814e496817a0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:43.934260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-23a616ff-7292-418a-831e-814e496817a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:43.996625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1255/2512] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:44.006770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:44.009053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:44.082658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f766739-855c-4df4-bad5-87ff1d87a392 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:44.086605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:44.087220 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:44.087502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:44.087775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:44.097750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:44.099275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:44.110312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1258/2513] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:44.518417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a616ff-7292-418a-831e-814e496817a0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:44.522607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-23a616ff-7292-418a-831e-814e496817a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:44.532492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a616ff-7292-418a-831e-814e496817a0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:44.538276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:44.538977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:44.539203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:44.539482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] PATH_INFO: `/v3/projects/b87117dbfc414cb4ab38b9206288c90e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:44.540617 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87117dbfc414cb4ab38b9206288c90e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:44.542619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:44.642004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87117dbfc414cb4ab38b9206288c90e', 'request_id': 'req-07035c22-3e0d-4911-ae81-6f2af2aaae15'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:44.648199 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87117dbfc414cb4ab38b9206288c90e', 'request_id': 'req-07035c22-3e0d-4911-ae81-6f2af2aaae15'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:44.654633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87117dbfc414cb4ab38b9206288c90e', 'request_id': 'req-07035c22-3e0d-4911-ae81-6f2af2aaae15'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:44.722967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] The token cache is being invalidate because project b87117dbfc414cb4ab38b9206288c90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:44.723430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:44.724412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:44.726418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1256/2514] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:44 2022] DELETE /identity/v3/projects/b87117dbfc414cb4ab38b9206288c90e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:53.890402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:53.900006 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91771-c9d6-44ed-ad32-cfdb6675dc9b service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:53.904740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:53.953513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:53.954783 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:53.955062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:53.955332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:53.957071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:54.022167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:54.023603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:54.033924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1259/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:54.720934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:58.190586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:58.192255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:58.270711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07035c22-3e0d-4911-ae81-6f2af2aaae15 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:58.275993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:58.276700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:58.277045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:58.277473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:58.279600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:58.293582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:58.295223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:58.306573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1257/2516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:15:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:15:58.380386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:58.382138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:58.395148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6913f59-231e-4674-8f07-9b17756a2a35 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:58.403142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:58.403142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:58.403142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:58.403142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] PATH_INFO: `/v3/users/a7356e1101a14bc7a7a9d0565461c318` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:58.404428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7356e1101a14bc7a7a9d0565461c318)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:58.407538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:58.569701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7356e1101a14bc7a7a9d0565461c318'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:58.618654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7356e1101a14bc7a7a9d0565461c318'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:58.626736 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7356e1101a14bc7a7a9d0565461c318'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:58.627410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7356e1101a14bc7a7a9d0565461c318'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:58.640537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c4d64e74-9c92-4c9a-a4f4-255e01733b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7356e1101a14bc7a7a9d0565461c318'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:58.647056 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1260/2517] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:15:58 2022] DELETE /identity/v3/users/a7356e1101a14bc7a7a9d0565461c318 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:58.887674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:58.901962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308f803-7578-426b-abaf-4cdf5eac429a service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:58.978269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:58.978977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:58.979266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:58.980853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] PATH_INFO: `/v3/projects/fe375d9f6def406ca33fac0337bcd636` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:58.981729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe375d9f6def406ca33fac0337bcd636)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:58.984007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:59.118731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe375d9f6def406ca33fac0337bcd636', 'request_id': 'req-78144994-b846-4ae4-92bf-2560a3ebed41'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:59.126104 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe375d9f6def406ca33fac0337bcd636', 'request_id': 'req-78144994-b846-4ae4-92bf-2560a3ebed41'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:59.133256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe375d9f6def406ca33fac0337bcd636', 'request_id': 'req-78144994-b846-4ae4-92bf-2560a3ebed41'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:59.255770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] The token cache is being invalidate because project fe375d9f6def406ca33fac0337bcd636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:15:59.256383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:59.261425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78144994-b846-4ae4-92bf-2560a3ebed41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:15:59.261425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1258/2518] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:15:58 2022] DELETE /identity/v3/projects/fe375d9f6def406ca33fac0337bcd636 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:15:59.263361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376947-9710-4f70-be91-cbe4623b396c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.263655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376947-9710-4f70-be91-cbe4623b396c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.264015 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376947-9710-4f70-be91-cbe4623b396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.286361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b0376947-9710-4f70-be91-cbe4623b396c None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:59.287588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b0376947-9710-4f70-be91-cbe4623b396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:59.316148 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:59.349672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1261/2519] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:59.357685 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaced1-e315-4013-9660-c6bd75222899 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.358072 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaced1-e315-4013-9660-c6bd75222899 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.358413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaced1-e315-4013-9660-c6bd75222899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.379263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1eeaced1-e315-4013-9660-c6bd75222899 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:59.380474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1eeaced1-e315-4013-9660-c6bd75222899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:15:59.388656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1259/2520] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:15:59.394598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0376947-9710-4f70-be91-cbe4623b396c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:59.407476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0376947-9710-4f70-be91-cbe4623b396c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:59.412842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:59.413571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.413984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.414342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.415081 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:15:59.415482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:59.417403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:59.430626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1262/2521] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:15:59.434944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaced1-e315-4013-9660-c6bd75222899 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:59.445592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaced1-e315-4013-9660-c6bd75222899 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:59.450424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:59.451096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.451445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.451787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.452482 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:59.455136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:59.466845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:15:59.521517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1260/2522] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:15:59 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:59.523854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:59.536413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801b70e-5bbd-46f8-8c60-8a1a035bdada admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:59.629549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:59.630203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.630486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.630759 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.631386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:59.633481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:59.741200 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1263/2523] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:15:59 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:15:59.745278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:59.757099 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183bd56-7bdf-48f4-b74b-920d6c061f6d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:59.761920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:59.768011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.768011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.768011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.768011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:59.768011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:59.776606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1261/2524] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:59.780651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:59.793892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40b8ee-2e8d-4d37-add4-6f6bdffecadd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:59.796514 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdae94-2f71-4a78-8a03-e030f6f8f542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:59.797134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdae94-2f71-4a78-8a03-e030f6f8f542 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.797964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdae94-2f71-4a78-8a03-e030f6f8f542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.798871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdae94-2f71-4a78-8a03-e030f6f8f542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.799534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdae94-2f71-4a78-8a03-e030f6f8f542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:59.801146 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdae94-2f71-4a78-8a03-e030f6f8f542 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:59.812492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1264/2525] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:15:59.817780 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:15:59.831416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0470-d3c9-407c-8991-4732715a53f3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:15:59.836946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:15:59.837624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.837949 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.838228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] PATH_INFO: `/v3/projects/32dd7027a91240c098647c58c77ce063/users/2712e5046e4346e88f4fa3470decbdbd/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.856942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dd7027a91240c098647c58c77ce063, user_id=2712e5046e4346e88f4fa3470decbdbd, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:15:59.860117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:15:59.944634 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1262/2526] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:15:59 2022] PUT /identity/v3/projects/32dd7027a91240c098647c58c77ce063/users/2712e5046e4346e88f4fa3470decbdbd/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:15:59.955279 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5efb6-1e0c-4c0f-94df-85a8a50d7ae0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:15:59.955569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5efb6-1e0c-4c0f-94df-85a8a50d7ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:15:59.955847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5efb6-1e0c-4c0f-94df-85a8a50d7ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:15:59.986672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-57e5efb6-1e0c-4c0f-94df-85a8a50d7ae0 None None] MFA Rules not processed for user `2712e5046e4346e88f4fa3470decbdbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:15:59.987954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-57e5efb6-1e0c-4c0f-94df-85a8a50d7ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:00.054436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1265/2527] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:15:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:00.059866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:00.130969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28439b-2301-4d6c-aa4e-a651f0e454fc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:00.135597 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:00.136195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.136474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.136747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.137428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:00.139361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:00.220757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1263/2528] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:00 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:00.224943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5efb6-1e0c-4c0f-94df-85a8a50d7ae0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:00.235914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5efb6-1e0c-4c0f-94df-85a8a50d7ae0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:00.259225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:00.290406 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:00.290999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.291324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.291597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.292226 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:00.294159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:00.407463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1266/2529] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:00 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:00.411576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:00.421854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40e4a7-1ff7-419a-b289-251f62ff3658 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:00.426763 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:00.428238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.428238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.428238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.428647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:00.430085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:00.440413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1264/2530] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:00.444487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:00.455108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea70a3a-83dd-4112-a938-481c199eeaab admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:00.461466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:00.462294 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.462581 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.462863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] PATH_INFO: `/v3/projects/97d1f36184b442b194b4875246c24de1/users/ccd5706ceaf34d6baa89e6810d2ccae5/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.482317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d1f36184b442b194b4875246c24de1, user_id=ccd5706ceaf34d6baa89e6810d2ccae5, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:00.485149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:00.607551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1267/2531] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:00 2022] PUT /identity/v3/projects/97d1f36184b442b194b4875246c24de1/users/ccd5706ceaf34d6baa89e6810d2ccae5/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:00.611793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:00.621950 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a5002-9398-4f84-aa4b-f882cc359a3b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:00.688596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0286d-6d12-4e42-8a5a-adf635cf6bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:00.689274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0286d-6d12-4e42-8a5a-adf635cf6bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.689466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0286d-6d12-4e42-8a5a-adf635cf6bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.689734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0286d-6d12-4e42-8a5a-adf635cf6bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.690402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0286d-6d12-4e42-8a5a-adf635cf6bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:00.691964 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0286d-6d12-4e42-8a5a-adf635cf6bd9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:00.701598 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1265/2532] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:00.706450 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:00.716793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f903999-bfaf-4e99-b798-729394a9d147 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:00.722114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:00.722764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.723046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.723321 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] PATH_INFO: `/v3/projects/97d1f36184b442b194b4875246c24de1/users/ccd5706ceaf34d6baa89e6810d2ccae5/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.725307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d1f36184b442b194b4875246c24de1, user_id=ccd5706ceaf34d6baa89e6810d2ccae5, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:00.728381 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:00.741470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1268/2533] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:00 2022] PUT /identity/v3/projects/97d1f36184b442b194b4875246c24de1/users/ccd5706ceaf34d6baa89e6810d2ccae5/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:00.756507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed398-d472-43cd-9b8c-0808831a9bdf None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.756793 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed398-d472-43cd-9b8c-0808831a9bdf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.757071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed398-d472-43cd-9b8c-0808831a9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.786277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-695ed398-d472-43cd-9b8c-0808831a9bdf None None] MFA Rules not processed for user `ccd5706ceaf34d6baa89e6810d2ccae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:00.787491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-695ed398-d472-43cd-9b8c-0808831a9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:00.800759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:00.869528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1266/2534] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:00.881385 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:00.883091 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:00.943552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46ec4-157e-4bde-bee4-f4af72b34ece admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:00.947426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:00.948062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:00.948336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:00.948605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:00.961315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:00.961315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:00.971029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1269/2535] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:01.165229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed398-d472-43cd-9b8c-0808831a9bdf None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:01.176425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed398-d472-43cd-9b8c-0808831a9bdf None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:01.180066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:01.180681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:01.180967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:01.181241 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:01.243108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:01.244490 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:01.254423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1267/2536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:05.541564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:05.543090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:05.601424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece5419-b3f9-4396-878b-c89cd485ea06 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:05.605028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:05.605634 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:05.605942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:05.606220 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:05.607915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:05.642066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:05.670433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:05.671869 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:05.682233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1270/2537] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:09.104477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:09.106173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:09.121544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6597f3-a621-4fb0-bf9f-1e2e79633740 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:09.126538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:09.126875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:09.127149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:09.127419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] PATH_INFO: `/v3/users/a8e8dd3db526404ebdd61b4fa8e92d92` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:09.128606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e8dd3db526404ebdd61b4fa8e92d92)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:09.130564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:09.290441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e8dd3db526404ebdd61b4fa8e92d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.291076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e8dd3db526404ebdd61b4fa8e92d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.354801 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e8dd3db526404ebdd61b4fa8e92d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.362656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e8dd3db526404ebdd61b4fa8e92d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.374686 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aa0f06e3-1045-4b6c-87a4-f53277758555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e8dd3db526404ebdd61b4fa8e92d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.381034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1268/2538] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:09 2022] DELETE /identity/v3/users/a8e8dd3db526404ebdd61b4fa8e92d92 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:09.603250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:09.619599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff56538-73fe-4947-8deb-2079a3da1ab8 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:09.685318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:09.685989 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:09.686264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:09.686533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] PATH_INFO: `/v3/projects/b12c605fd9844936ba9abf115ba753db` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:09.687646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12c605fd9844936ba9abf115ba753db)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:09.690397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:09.820410 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12c605fd9844936ba9abf115ba753db', 'request_id': 'req-128c1b29-bb17-4013-a140-0bf5f47c796e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.827078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12c605fd9844936ba9abf115ba753db', 'request_id': 'req-128c1b29-bb17-4013-a140-0bf5f47c796e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.836328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12c605fd9844936ba9abf115ba753db', 'request_id': 'req-128c1b29-bb17-4013-a140-0bf5f47c796e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.909049 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] The token cache is being invalidate because project b12c605fd9844936ba9abf115ba753db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:09.909389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.910034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-128c1b29-bb17-4013-a140-0bf5f47c796e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:09.911516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1271/2539] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:09 2022] DELETE /identity/v3/projects/b12c605fd9844936ba9abf115ba753db => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:09.916469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996a39-18c7-44ea-8b92-19ff192a7ed7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:09.916696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996a39-18c7-44ea-8b92-19ff192a7ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:09.916987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f996a39-18c7-44ea-8b92-19ff192a7ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:09.936786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0f996a39-18c7-44ea-8b92-19ff192a7ed7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:09.939925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0f996a39-18c7-44ea-8b92-19ff192a7ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:09.956388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:10.001003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1269/2540] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:10.010436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88752d2-4169-4097-85eb-0a0300d3af02 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.010726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88752d2-4169-4097-85eb-0a0300d3af02 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.011003 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88752d2-4169-4097-85eb-0a0300d3af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.030484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d88752d2-4169-4097-85eb-0a0300d3af02 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:10.031679 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d88752d2-4169-4097-85eb-0a0300d3af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:10.039620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1272/2541] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:10.043900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996a39-18c7-44ea-8b92-19ff192a7ed7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:10.054033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f996a39-18c7-44ea-8b92-19ff192a7ed7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:10.059762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:10.059762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.059762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.060254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.060445 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:10.060754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:10.062448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:10.074874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1270/2542] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:10.079116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88752d2-4169-4097-85eb-0a0300d3af02 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:10.088501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88752d2-4169-4097-85eb-0a0300d3af02 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:10.093247 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:10.093884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.094173 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.094451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.095084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:10.097189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:10.232171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1273/2543] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:10 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:10.237164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:10.248918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a70268-caef-45bf-943c-d2e047673ed0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:10.309144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:10.309787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.310094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.310371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.311008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:10.312934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:10.438093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1271/2544] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:10 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:10.442562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:10.453203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eb86d-21f6-4d29-bc9b-967e68d99412 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:10.457966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:10.458592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.458843 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.459165 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.459808 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:10.461582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:10.472070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1274/2545] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:10.476392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:10.487666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c039c-66aa-4080-bc11-9450129bcaaa admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:10.492366 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739825e-e1f6-44f4-b7f6-6fb960c2957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:10.493131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739825e-e1f6-44f4-b7f6-6fb960c2957e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.493414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739825e-e1f6-44f4-b7f6-6fb960c2957e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.493695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739825e-e1f6-44f4-b7f6-6fb960c2957e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.494508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739825e-e1f6-44f4-b7f6-6fb960c2957e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:10.496105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739825e-e1f6-44f4-b7f6-6fb960c2957e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:10.507383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1272/2546] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:10.511436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:10.521296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa343082-66d9-4dd8-8c05-2dbce2c18cb0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:10.525930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:10.526576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.526861 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.527131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] PATH_INFO: `/v3/projects/9f946b4f71a048b284d3cdcc2eb5be09/users/9f5bc7a7c31d471781d3e5407102fd4f/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.543982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f946b4f71a048b284d3cdcc2eb5be09, user_id=9f5bc7a7c31d471781d3e5407102fd4f, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:10.546669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:10.635909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:10.641572 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1275/2547] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:10 2022] PUT /identity/v3/projects/9f946b4f71a048b284d3cdcc2eb5be09/users/9f5bc7a7c31d471781d3e5407102fd4f/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:10.655447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61391e3e-388c-44c0-9893-0c4acf5bfa18 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.655731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61391e3e-388c-44c0-9893-0c4acf5bfa18 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.656001 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61391e3e-388c-44c0-9893-0c4acf5bfa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.684155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-61391e3e-388c-44c0-9893-0c4acf5bfa18 None None] MFA Rules not processed for user `9f5bc7a7c31d471781d3e5407102fd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:10.685344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-61391e3e-388c-44c0-9893-0c4acf5bfa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:10.750178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1273/2548] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:10.762703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:10.764423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:10.841031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b458-ff59-409d-9cd2-ce12d829698d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:10.847296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7637da8-199b-401e-b5d2-47651dfefa85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:10.847898 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7637da8-199b-401e-b5d2-47651dfefa85 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:10.848187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7637da8-199b-401e-b5d2-47651dfefa85 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:10.848462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7637da8-199b-401e-b5d2-47651dfefa85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:10.856401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7637da8-199b-401e-b5d2-47651dfefa85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:10.858014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7637da8-199b-401e-b5d2-47651dfefa85 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:10.867835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1276/2549] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:11.075210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61391e3e-388c-44c0-9893-0c4acf5bfa18 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:11.094571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:11.139152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61391e3e-388c-44c0-9893-0c4acf5bfa18 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:11.144831 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:11.145456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:11.145736 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:11.146052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] PATH_INFO: `/v3/users/9f5bc7a7c31d471781d3e5407102fd4f` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:11.147217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5bc7a7c31d471781d3e5407102fd4f)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:11.149089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:11.341331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5bc7a7c31d471781d3e5407102fd4f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:11.342068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5bc7a7c31d471781d3e5407102fd4f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:11.412606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5bc7a7c31d471781d3e5407102fd4f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:11.422193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5bc7a7c31d471781d3e5407102fd4f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:11.436109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5bc7a7c31d471781d3e5407102fd4f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:11.443359 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1274/2550] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:11 2022] DELETE /identity/v3/users/9f5bc7a7c31d471781d3e5407102fd4f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:11.447921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:11.448214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:11.448497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:11.474009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:11.475436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:11.543812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1277/2551] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:11.554877 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:11.556391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:11.614660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71ee49-0b97-44a2-8701-a9b32b1485a4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:11.618328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d499ce-e227-4412-9377-3b2a532825ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:11.618931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d499ce-e227-4412-9377-3b2a532825ae service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:11.619213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d499ce-e227-4412-9377-3b2a532825ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:11.619486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d499ce-e227-4412-9377-3b2a532825ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:11.629293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d499ce-e227-4412-9377-3b2a532825ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:11.630754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d499ce-e227-4412-9377-3b2a532825ae service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:11.640259 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1275/2552] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:12.026707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:12.028160 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:12.040803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c047ac-5503-4b8f-b1e7-98b5276038a7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:12.045517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:12.046231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.052944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.052944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] PATH_INFO: `/v3/projects/9f946b4f71a048b284d3cdcc2eb5be09` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.052944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f946b4f71a048b284d3cdcc2eb5be09)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:12.052944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:12.178911 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f946b4f71a048b284d3cdcc2eb5be09', 'request_id': 'req-ab4ebf22-545f-4895-98ed-e18c8a802ba6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:12.184509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f946b4f71a048b284d3cdcc2eb5be09', 'request_id': 'req-ab4ebf22-545f-4895-98ed-e18c8a802ba6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:12.191401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f946b4f71a048b284d3cdcc2eb5be09', 'request_id': 'req-ab4ebf22-545f-4895-98ed-e18c8a802ba6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:12.314409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] The token cache is being invalidate because project 9f946b4f71a048b284d3cdcc2eb5be09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:12.314709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:12.315926 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ab4ebf22-545f-4895-98ed-e18c8a802ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:12.317509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1278/2553] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:12 2022] DELETE /identity/v3/projects/9f946b4f71a048b284d3cdcc2eb5be09 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:12.322903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b904b-3ea8-4cf8-988c-111c37b38383 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.323192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b904b-3ea8-4cf8-988c-111c37b38383 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.323465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b904b-3ea8-4cf8-988c-111c37b38383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.343815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f02b904b-3ea8-4cf8-988c-111c37b38383 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:12.345043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f02b904b-3ea8-4cf8-988c-111c37b38383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:12.380768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:12.407043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1276/2554] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:12.415473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d86e-ff1a-4690-b3c8-75d45886cd4a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.415764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d86e-ff1a-4690-b3c8-75d45886cd4a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.416038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910d86e-ff1a-4690-b3c8-75d45886cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.435937 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:12.436159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2910d86e-ff1a-4690-b3c8-75d45886cd4a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:12.437273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2910d86e-ff1a-4690-b3c8-75d45886cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:12.445635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1279/2555] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:12.449960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b904b-3ea8-4cf8-988c-111c37b38383 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:12.459973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b904b-3ea8-4cf8-988c-111c37b38383 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:12.465223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:12.470031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.470031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.470031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.470031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:12.470031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:12.470031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:12.481431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1277/2556] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:12.485976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d86e-ff1a-4690-b3c8-75d45886cd4a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:12.495163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910d86e-ff1a-4690-b3c8-75d45886cd4a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:12.500152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:12.500883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.501334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.501630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.502357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:12.504314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:12.596750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1280/2557] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:12 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:12.601164 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:12.611492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32b5b-420e-4616-928e-1829c5011614 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:12.668629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:12.669242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.669529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.669839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.670474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:12.672402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:12.734085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1278/2558] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:12 2022] POST /identity/v3/users => generated 302 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:12.739034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:12.749563 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52097f6a-b073-4c6c-bed2-6cddf3b901ea admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:12.754411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:12.754999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.755307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.755579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.756209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:12.757859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:12.767664 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1281/2559] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:12.771549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:12.781424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efe568-3ab7-4d98-8925-2d044cd3f3b6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:12.786538 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b519204-8c57-4662-8774-8e6a1ebcc7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:12.787124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b519204-8c57-4662-8774-8e6a1ebcc7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.787400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b519204-8c57-4662-8774-8e6a1ebcc7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.787667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b519204-8c57-4662-8774-8e6a1ebcc7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.788294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b519204-8c57-4662-8774-8e6a1ebcc7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:12.789889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b519204-8c57-4662-8774-8e6a1ebcc7b7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:12.800982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1279/2560] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:12.804940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:12.816225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a93a7-f7bc-4f74-9f1b-eb007c698d9b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:12.821058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:12.821782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.822100 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.822377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] PATH_INFO: `/v3/projects/cf44c35c21684d108f94516bb5edadc2/users/3393cf94abca40b69b4b6f39030c6459/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.839124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf44c35c21684d108f94516bb5edadc2, user_id=3393cf94abca40b69b4b6f39030c6459, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:12.841746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:12.910469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1282/2561] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:12 2022] PUT /identity/v3/projects/cf44c35c21684d108f94516bb5edadc2/users/3393cf94abca40b69b4b6f39030c6459/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:12.916769 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6d18-f2a2-4075-ac85-d86ccea2062f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:12.917354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6d18-f2a2-4075-ac85-d86ccea2062f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:12.917904 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f6d18-f2a2-4075-ac85-d86ccea2062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:12.941507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-561f6d18-f2a2-4075-ac85-d86ccea2062f None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:12.942851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-561f6d18-f2a2-4075-ac85-d86ccea2062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:13.002690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1280/2562] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:13.012766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:13.015342 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:13.074944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69be786-69d6-44d1-92f7-2f245cb4a702 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:13.078777 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:13.079421 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:13.079798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:13.079968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:13.090692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:13.092327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:13.105071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1283/2563] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:14.228031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba40dc-b9b4-4f25-aac8-f3320e361a91 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:14.228588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba40dc-b9b4-4f25-aac8-f3320e361a91 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:14.228588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba40dc-b9b4-4f25-aac8-f3320e361a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:14.257989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-02ba40dc-b9b4-4f25-aac8-f3320e361a91 None None] MFA Rules not processed for user `3393cf94abca40b69b4b6f39030c6459`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:14.259278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-02ba40dc-b9b4-4f25-aac8-f3320e361a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:14.295580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:14.332452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1281/2564] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:14 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:14.333824 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:14.344880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066076b6-6ed0-4534-a49f-18744e6e1c46 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:14.349855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:14.350471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:14.351219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:14.351492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:14.352136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:14.354114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:14.459420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1284/2565] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:14 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:14.459951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba40dc-b9b4-4f25-aac8-f3320e361a91 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:14.470954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba40dc-b9b4-4f25-aac8-f3320e361a91 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:14.530262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:14.531020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:14.531377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:14.531725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:14.532521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:14.534754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:14.618376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1282/2566] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:14 2022] POST /identity/v3/users => generated 309 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:14.622487 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:14.633188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc90254-a243-43d9-a444-0fb37a13ac7e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:14.637918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:14.638511 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:14.638796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:14.639095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:14.639775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:14.641393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:14.652946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1285/2567] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:14.658115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:14.667853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bc6d1-dece-4e55-99aa-72a7baa5207c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:14.672462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:14.673140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:14.673443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:14.675040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] PATH_INFO: `/v3/projects/82a164f2798843efad09a7f8cd49c7c1/users/7f4d8959f63640e4aba52bec0320ba00/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:14.688541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a164f2798843efad09a7f8cd49c7c1, user_id=7f4d8959f63640e4aba52bec0320ba00, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:14.691371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:14.790512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1283/2568] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:14 2022] PUT /identity/v3/projects/82a164f2798843efad09a7f8cd49c7c1/users/7f4d8959f63640e4aba52bec0320ba00/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:14.794564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:14.804703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf24116-9deb-47fe-b2d9-7860fcbd4e38 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:14.864058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc26fb-0f8e-4930-973c-5b889b10393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:14.864709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc26fb-0f8e-4930-973c-5b889b10393f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:14.865047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc26fb-0f8e-4930-973c-5b889b10393f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:14.865285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc26fb-0f8e-4930-973c-5b889b10393f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:14.865953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc26fb-0f8e-4930-973c-5b889b10393f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:14.867539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc26fb-0f8e-4930-973c-5b889b10393f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:14.877216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1286/2569] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:14.881512 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:14.892437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3e60-e566-4c84-b14a-376d6796692f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:14.897005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:14.897895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:14.898179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:14.898451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] PATH_INFO: `/v3/projects/82a164f2798843efad09a7f8cd49c7c1/users/7f4d8959f63640e4aba52bec0320ba00/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:14.900334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a164f2798843efad09a7f8cd49c7c1, user_id=7f4d8959f63640e4aba52bec0320ba00, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:14.903139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:14.914408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1284/2570] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:14 2022] PUT /identity/v3/projects/82a164f2798843efad09a7f8cd49c7c1/users/7f4d8959f63640e4aba52bec0320ba00/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:16.556033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c44b-f386-4603-a9b2-24581eb04ced None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:16.556583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c44b-f386-4603-a9b2-24581eb04ced None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:16.556583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c44b-f386-4603-a9b2-24581eb04ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:16.577313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:16.586994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2f31c44b-f386-4603-a9b2-24581eb04ced None None] MFA Rules not processed for user `7f4d8959f63640e4aba52bec0320ba00`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:16.588745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2f31c44b-f386-4603-a9b2-24581eb04ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:16.661625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1287/2571] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:18.236844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:18.313357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaa39a-e2a9-4355-9f4f-d4a107df0122 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:18.319416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:18.324228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:18.324228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:18.324228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] PATH_INFO: `/v3/users/3393cf94abca40b69b4b6f39030c6459` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:18.324228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3393cf94abca40b69b4b6f39030c6459)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:18.324228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:18.522859 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:18.542517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3393cf94abca40b69b4b6f39030c6459'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:18.543312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3393cf94abca40b69b4b6f39030c6459'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:18.606934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3393cf94abca40b69b4b6f39030c6459'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:18.615641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3393cf94abca40b69b4b6f39030c6459'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:18.631337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3393cf94abca40b69b4b6f39030c6459'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:18.637688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1285/2572] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:18 2022] DELETE /identity/v3/users/3393cf94abca40b69b4b6f39030c6459 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:18.988539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c44b-f386-4603-a9b2-24581eb04ced None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:19.003344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c44b-f386-4603-a9b2-24581eb04ced None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:19.115343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:19.116585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:19.117040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:19.117468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] PATH_INFO: `/v3/projects/cf44c35c21684d108f94516bb5edadc2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:19.118924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf44c35c21684d108f94516bb5edadc2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:19.121057 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:19.273189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf44c35c21684d108f94516bb5edadc2', 'request_id': 'req-e5dde7b3-44b4-4d34-8951-65e79de057e6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.281398 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf44c35c21684d108f94516bb5edadc2', 'request_id': 'req-e5dde7b3-44b4-4d34-8951-65e79de057e6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.291135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf44c35c21684d108f94516bb5edadc2', 'request_id': 'req-e5dde7b3-44b4-4d34-8951-65e79de057e6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.413448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] The token cache is being invalidate because project cf44c35c21684d108f94516bb5edadc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:19.413747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.414498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.416009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1288/2573] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:18 2022] DELETE /identity/v3/projects/cf44c35c21684d108f94516bb5edadc2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:19.420902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:19.422507 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:19.438632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6fb72-3633-46ef-b560-9bc7406035e1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:19.503553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:19.503839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:19.504176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:19.504513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] PATH_INFO: `/v3/users/7f4d8959f63640e4aba52bec0320ba00` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:19.506281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4d8959f63640e4aba52bec0320ba00)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:19.508760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:19.684977 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4d8959f63640e4aba52bec0320ba00'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.685779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4d8959f63640e4aba52bec0320ba00'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.766847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4d8959f63640e4aba52bec0320ba00'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.774922 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4d8959f63640e4aba52bec0320ba00'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.788413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-119af17e-9486-400e-aa5d-24b224282b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4d8959f63640e4aba52bec0320ba00'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:19.794325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1286/2574] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:19 2022] DELETE /identity/v3/users/7f4d8959f63640e4aba52bec0320ba00 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:20.053720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:20.055827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:20.076316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dde7b3-44b4-4d34-8951-65e79de057e6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:20.114143 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:20.153263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:20.153931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.154218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.154714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] PATH_INFO: `/v3/projects/82a164f2798843efad09a7f8cd49c7c1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.155881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a164f2798843efad09a7f8cd49c7c1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:20.158720 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:20.300195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a164f2798843efad09a7f8cd49c7c1', 'request_id': 'req-f13d4261-2367-4d75-9295-8d80a4cd74cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:20.305953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a164f2798843efad09a7f8cd49c7c1', 'request_id': 'req-f13d4261-2367-4d75-9295-8d80a4cd74cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:20.320469 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a164f2798843efad09a7f8cd49c7c1', 'request_id': 'req-f13d4261-2367-4d75-9295-8d80a4cd74cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:20.380497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] The token cache is being invalidate because project 82a164f2798843efad09a7f8cd49c7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:20.381366 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:20.381859 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13d4261-2367-4d75-9295-8d80a4cd74cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:20.383691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1289/2575] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:20 2022] DELETE /identity/v3/projects/82a164f2798843efad09a7f8cd49c7c1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:20.388268 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae051-afe7-4904-9663-034fe1bb0cb3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.388546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae051-afe7-4904-9663-034fe1bb0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.388818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae051-afe7-4904-9663-034fe1bb0cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.412103 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-dd5ae051-afe7-4904-9663-034fe1bb0cb3 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:20.413351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dd5ae051-afe7-4904-9663-034fe1bb0cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:20.437005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:20.487790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1287/2576] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:20.495450 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e6bc6-9f36-49e1-8443-ee0c1142a74d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.495739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e6bc6-9f36-49e1-8443-ee0c1142a74d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.496016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e6bc6-9f36-49e1-8443-ee0c1142a74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.515957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0e2e6bc6-9f36-49e1-8443-ee0c1142a74d None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:20.517920 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e2e6bc6-9f36-49e1-8443-ee0c1142a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:20.526383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1290/2577] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:20.531220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae051-afe7-4904-9663-034fe1bb0cb3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:20.544498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae051-afe7-4904-9663-034fe1bb0cb3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:20.551983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:20.556318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.556318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.556318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.556318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:20.556318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:20.558054 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:20.574331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1288/2578] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:20.578481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e6bc6-9f36-49e1-8443-ee0c1142a74d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:20.593092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e6bc6-9f36-49e1-8443-ee0c1142a74d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:20.598555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:20.599158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.599680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.600218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.601357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:20.603585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:20.699854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1291/2579] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:20 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:20.704555 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:20.714485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1ca5b-4f33-433b-a740-33c94784da31 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:20.772720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:20.773325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.773610 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.773924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.774559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:20.776509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:20.855806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1289/2580] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:20 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:20.857090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:20.867922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f9b8-c18f-4d8f-8dd1-995ec097058d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:20.872821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:20.873533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.873914 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.874274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.875022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:20.877361 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:20.890075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1292/2581] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:20.894309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:20.904770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7e3c2-f4fb-4357-94ee-d33acc9f17c0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:20.914799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda365-c5d7-4432-950f-0ae70e01b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:20.914799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda365-c5d7-4432-950f-0ae70e01b76a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.914799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda365-c5d7-4432-950f-0ae70e01b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.914799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda365-c5d7-4432-950f-0ae70e01b76a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.915184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bda365-c5d7-4432-950f-0ae70e01b76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:20.915184 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bda365-c5d7-4432-950f-0ae70e01b76a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:20.925136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1290/2582] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:20.929380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:20.940326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989df12-7862-41ee-b662-a0564d5f39cd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:20.946354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:20.946967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:20.947388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:20.947675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] PATH_INFO: `/v3/projects/20c295fb17c946deaafc82847d8475aa/users/6db2df1ed2134006a0c2a4122241a77d/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:20.963790 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c295fb17c946deaafc82847d8475aa, user_id=6db2df1ed2134006a0c2a4122241a77d, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:20.966517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.052550 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1293/2583] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:20 2022] PUT /identity/v3/projects/20c295fb17c946deaafc82847d8475aa/users/6db2df1ed2134006a0c2a4122241a77d/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:21.064052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49d72-f81f-4cab-9b5c-e2a6e361c776 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.064377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49d72-f81f-4cab-9b5c-e2a6e361c776 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.066158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc49d72-f81f-4cab-9b5c-e2a6e361c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.092986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9cc49d72-f81f-4cab-9b5c-e2a6e361c776 None None] MFA Rules not processed for user `6db2df1ed2134006a0c2a4122241a77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:21.094249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9cc49d72-f81f-4cab-9b5c-e2a6e361c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:21.167337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1291/2584] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:21.171954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:21.225141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:21.236624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57684a9-f37b-4882-bb92-ba890df1cc34 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:21.241364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:21.241994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.242282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.242559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.243181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:21.245092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.323137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1294/2585] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:21 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:21.327478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc49d72-f81f-4cab-9b5c-e2a6e361c776 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:21.339057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc49d72-f81f-4cab-9b5c-e2a6e361c776 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:21.357970 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:21.396205 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:21.396824 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.397106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.397387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.398058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:21.399983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.475137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1292/2586] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:21 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:21.479344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:21.490314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc46414-232c-4574-82ff-cd40a5e14af4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:21.494964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:21.495552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.495830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.496102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.496734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:21.498355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.508938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1295/2587] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:21.513261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:21.523410 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60dfc-1726-4138-8db3-d91158be99b9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:21.528128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:21.528786 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.529069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.529346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] PATH_INFO: `/v3/projects/c114ddd8b0ac43079bf58eff7b74a335/users/344bef903f3241dc868ab41c5741778a/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.546275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c114ddd8b0ac43079bf58eff7b74a335, user_id=344bef903f3241dc868ab41c5741778a, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:21.549833 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.624256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1293/2588] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:21 2022] PUT /identity/v3/projects/c114ddd8b0ac43079bf58eff7b74a335/users/344bef903f3241dc868ab41c5741778a/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:21.628574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:21.649101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53996b9-c9a7-44b7-b61d-4c0a07de04a7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:21.698945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894803-1a33-4998-852d-0a55c6d5f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:21.699685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894803-1a33-4998-852d-0a55c6d5f4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.699967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894803-1a33-4998-852d-0a55c6d5f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.700241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894803-1a33-4998-852d-0a55c6d5f4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.700887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894803-1a33-4998-852d-0a55c6d5f4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:21.702661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894803-1a33-4998-852d-0a55c6d5f4ff admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.716409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1296/2589] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:21.717807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:21.729240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c487cc-55b1-4b90-801d-8a5071382bae admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:21.734347 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:21.735061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.735289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.735588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] PATH_INFO: `/v3/projects/c114ddd8b0ac43079bf58eff7b74a335/users/344bef903f3241dc868ab41c5741778a/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.737528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c114ddd8b0ac43079bf58eff7b74a335, user_id=344bef903f3241dc868ab41c5741778a, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:21.740227 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.750715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1294/2590] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:21 2022] PUT /identity/v3/projects/c114ddd8b0ac43079bf58eff7b74a335/users/344bef903f3241dc868ab41c5741778a/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:21.762120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cdfd-2963-4a2d-8208-4927c2fee59b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.762409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cdfd-2963-4a2d-8208-4927c2fee59b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.762689 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413cdfd-2963-4a2d-8208-4927c2fee59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.794018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6413cdfd-2963-4a2d-8208-4927c2fee59b None None] MFA Rules not processed for user `344bef903f3241dc868ab41c5741778a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:21.795324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6413cdfd-2963-4a2d-8208-4927c2fee59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:21.874445 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1297/2591] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:21.886029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:21.887729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:21.947175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e73b3-6a78-42a2-8f1b-8a6045dbb3b7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:21.951128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1363e-5e77-4cb9-947e-0b03c09fd119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:21.951754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1363e-5e77-4cb9-947e-0b03c09fd119 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:21.952038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1363e-5e77-4cb9-947e-0b03c09fd119 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:21.952312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1363e-5e77-4cb9-947e-0b03c09fd119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:21.961811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1363e-5e77-4cb9-947e-0b03c09fd119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:21.963239 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1363e-5e77-4cb9-947e-0b03c09fd119 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:21.972656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1295/2592] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:22.001994 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413cdfd-2963-4a2d-8208-4927c2fee59b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:22.049484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:22.064107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413cdfd-2963-4a2d-8208-4927c2fee59b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:22.069016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:22.069644 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:22.069971 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:22.070254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] PATH_INFO: `/v3/users/6db2df1ed2134006a0c2a4122241a77d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:22.071414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db2df1ed2134006a0c2a4122241a77d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:22.073471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:22.248127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db2df1ed2134006a0c2a4122241a77d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:22.320588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db2df1ed2134006a0c2a4122241a77d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:22.328137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db2df1ed2134006a0c2a4122241a77d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:22.328792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db2df1ed2134006a0c2a4122241a77d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:22.341185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db2df1ed2134006a0c2a4122241a77d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:22.348018 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1298/2593] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:22 2022] DELETE /identity/v3/users/6db2df1ed2134006a0c2a4122241a77d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:22.352713 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:22.352999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:22.353353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:22.373926 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:22.375115 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:22.437806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1296/2594] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:22.447685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:22.449355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:22.508675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318465-d5c1-4e29-b734-cb4142962ca5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:22.512502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:22.513118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:22.513404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:22.513682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:22.522839 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:22.524276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:22.534227 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1299/2595] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:22.957455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:22.958929 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:22.977412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a52156-8833-44b7-bf42-c90f7ed9ba39 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:22.982314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:22.983122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:22.983229 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:22.983511 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] PATH_INFO: `/v3/projects/20c295fb17c946deaafc82847d8475aa` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:22.984887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c295fb17c946deaafc82847d8475aa)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:22.987484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:22.999541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:23.091693 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c295fb17c946deaafc82847d8475aa', 'request_id': 'req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.098578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c295fb17c946deaafc82847d8475aa', 'request_id': 'req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.105286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c295fb17c946deaafc82847d8475aa', 'request_id': 'req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.183162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] The token cache is being invalidate because project 20c295fb17c946deaafc82847d8475aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:23.183461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.184106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.185709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1297/2596] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:22 2022] DELETE /identity/v3/projects/20c295fb17c946deaafc82847d8475aa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:23.189991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:23.199574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aac6c0-c9cc-4538-8e8d-b4236ae00e0a service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:23.256925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:23.257606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:23.257975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:23.258257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] PATH_INFO: `/v3/users/344bef903f3241dc868ab41c5741778a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:23.259369 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=344bef903f3241dc868ab41c5741778a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:23.261316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:23.272111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:23.416301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344bef903f3241dc868ab41c5741778a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.460022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344bef903f3241dc868ab41c5741778a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.468232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344bef903f3241dc868ab41c5741778a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.472456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344bef903f3241dc868ab41c5741778a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.486335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344bef903f3241dc868ab41c5741778a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:23.492696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1300/2597] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:23 2022] DELETE /identity/v3/users/344bef903f3241dc868ab41c5741778a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:23.568429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:23.570666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:23.633665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5da0e-f442-4c7c-b5c9-e96d36e5d84a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:23.682972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa04f06-2513-446c-abce-1d907a130723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:23.683581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04f06-2513-446c-abce-1d907a130723 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:23.683864 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04f06-2513-446c-abce-1d907a130723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:23.684141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa04f06-2513-446c-abce-1d907a130723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:23.686083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8aa04f06-2513-446c-abce-1d907a130723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:23.757078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa04f06-2513-446c-abce-1d907a130723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:23.759135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa04f06-2513-446c-abce-1d907a130723 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:23.769728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1298/2598] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:24.018390 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:24.021957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:24.034358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599cc8c-e4ed-4369-8c95-f9c08a2c34cc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:24.038699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:24.039348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.039629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.039904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] PATH_INFO: `/v3/projects/c114ddd8b0ac43079bf58eff7b74a335` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.041048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c114ddd8b0ac43079bf58eff7b74a335)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:24.042992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:24.174640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c114ddd8b0ac43079bf58eff7b74a335', 'request_id': 'req-9c19fb05-d15b-49e5-b4c7-6c35a4704367'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:24.180370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c114ddd8b0ac43079bf58eff7b74a335', 'request_id': 'req-9c19fb05-d15b-49e5-b4c7-6c35a4704367'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:24.186785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c114ddd8b0ac43079bf58eff7b74a335', 'request_id': 'req-9c19fb05-d15b-49e5-b4c7-6c35a4704367'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:24.309221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] The token cache is being invalidate because project c114ddd8b0ac43079bf58eff7b74a335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:24.309875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:24.310229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9c19fb05-d15b-49e5-b4c7-6c35a4704367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:24.311993 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1301/2599] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:24 2022] DELETE /identity/v3/projects/c114ddd8b0ac43079bf58eff7b74a335 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:24.317912 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b9f0-44b6-4877-90c1-89e042038942 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.318401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b9f0-44b6-4877-90c1-89e042038942 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.318498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1b9f0-44b6-4877-90c1-89e042038942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.333185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:24.339408 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-10f1b9f0-44b6-4877-90c1-89e042038942 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:24.340615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-10f1b9f0-44b6-4877-90c1-89e042038942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:24.402791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1299/2600] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:24.411439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc46f-8aaf-45fa-b1cf-2fdd7da1c3a9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.411726 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc46f-8aaf-45fa-b1cf-2fdd7da1c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.412000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc46f-8aaf-45fa-b1cf-2fdd7da1c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.433236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c39fc46f-8aaf-45fa-b1cf-2fdd7da1c3a9 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:24.434696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c39fc46f-8aaf-45fa-b1cf-2fdd7da1c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:24.444043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1302/2601] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:24.448710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b9f0-44b6-4877-90c1-89e042038942 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:24.459506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1b9f0-44b6-4877-90c1-89e042038942 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:24.464286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:24.464897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.465179 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.465459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.466155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:24.466462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:24.468098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:24.482108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1300/2602] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:16:24.488659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc46f-8aaf-45fa-b1cf-2fdd7da1c3a9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:24.498106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc46f-8aaf-45fa-b1cf-2fdd7da1c3a9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:24.504531 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:24.505164 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.505438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.505713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.506399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:24.508313 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:24.621209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1303/2603] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:24 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:24.625325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:24.635672 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cef54-cbde-474a-95e7-637cb078c6d6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:24.696459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:24.697388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.698142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.698635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.699878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:24.703269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:24.827365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1301/2604] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:24 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:24.832593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:24.857063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4753cd-030b-4012-855a-64ea778a9e6f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:24.871238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:24.872185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.872626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.873055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.873902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:24.876775 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:24.889885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1304/2605] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:24.894987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:24.906124 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0a248-7fac-405d-abe5-6d6f203c9c76 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:24.912323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4a67c-69d7-4f63-bb1b-1309e2dc1dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:24.912852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4a67c-69d7-4f63-bb1b-1309e2dc1dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.913134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4a67c-69d7-4f63-bb1b-1309e2dc1dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.913412 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4a67c-69d7-4f63-bb1b-1309e2dc1dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.914135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4a67c-69d7-4f63-bb1b-1309e2dc1dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:24.915754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4a67c-69d7-4f63-bb1b-1309e2dc1dc1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:24.929835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1302/2606] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:24.933921 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:24.946833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb24e-156a-4407-9ca3-4c5638461e5f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:24.951958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:24.952629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:24.955501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:24.955501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] PATH_INFO: `/v3/projects/15c5dbc1cba54bc9bdf75a5ab141dc35/users/a77e1ce1c3474f0d86347e6fed95f7ca/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:24.969733 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c5dbc1cba54bc9bdf75a5ab141dc35, user_id=a77e1ce1c3474f0d86347e6fed95f7ca, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:24.972440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:25.079204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1305/2607] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:24 2022] PUT /identity/v3/projects/15c5dbc1cba54bc9bdf75a5ab141dc35/users/a77e1ce1c3474f0d86347e6fed95f7ca/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:25.081122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833183-b315-4463-ba9a-13e3ffc8b035 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.081409 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833183-b315-4463-ba9a-13e3ffc8b035 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.081742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833183-b315-4463-ba9a-13e3ffc8b035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.113300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9e833183-b315-4463-ba9a-13e3ffc8b035 None None] MFA Rules not processed for user `a77e1ce1c3474f0d86347e6fed95f7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:25.114846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9e833183-b315-4463-ba9a-13e3ffc8b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:25.195176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1303/2608] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:25.200242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:25.209954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=17,keystone:SELECT=79,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:25.271453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edbbec-6568-4d43-8b90-451913e79466 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:25.277282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:25.278042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.278397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.278740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.279535 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:25.281533 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:25.431325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1306/2609] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:25 2022] POST /identity/v3/projects => generated 393 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:25.433230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e833183-b315-4463-ba9a-13e3ffc8b035 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:25.442221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:25.448819 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e833183-b315-4463-ba9a-13e3ffc8b035 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:25.521580 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:25.522300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.522821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.523189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.523834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:25.525851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:25.612513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1304/2610] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:25 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:25.616798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:25.628694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb1e08-94fa-44af-9471-177dff6729e1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:25.634650 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:25.635448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.635829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.636199 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.636946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:25.639020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:25.652485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1307/2611] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:25.656548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:25.670225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccca3b-f54a-4455-9698-520479d305c7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:25.676236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:25.677137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.677422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.677697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] PATH_INFO: `/v3/projects/62aeef4cb3e94389a148a3a809b7e495/users/8ff4122a50d74f74a83d6c81d001accb/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.695665 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62aeef4cb3e94389a148a3a809b7e495, user_id=8ff4122a50d74f74a83d6c81d001accb, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:25.699012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:25.769401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1305/2612] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:25 2022] PUT /identity/v3/projects/62aeef4cb3e94389a148a3a809b7e495/users/8ff4122a50d74f74a83d6c81d001accb/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:25.773648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:25.785878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609adfd-76d1-4240-a79d-8afa18b887e7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:25.859826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011ccd1-6252-49b0-b129-7794d9bbfd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:25.860564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011ccd1-6252-49b0-b129-7794d9bbfd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.860848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011ccd1-6252-49b0-b129-7794d9bbfd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.861108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011ccd1-6252-49b0-b129-7794d9bbfd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.861882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011ccd1-6252-49b0-b129-7794d9bbfd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:25.863721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011ccd1-6252-49b0-b129-7794d9bbfd27 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:25.877804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1308/2613] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:25.879619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:25.890009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ed007-ab2e-4a64-aa33-37240ede88c1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:25.895195 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:25.895856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.896137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.896417 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] PATH_INFO: `/v3/projects/62aeef4cb3e94389a148a3a809b7e495/users/8ff4122a50d74f74a83d6c81d001accb/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.898383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62aeef4cb3e94389a148a3a809b7e495, user_id=8ff4122a50d74f74a83d6c81d001accb, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:25.901017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:25.912695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1306/2614] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:25 2022] PUT /identity/v3/projects/62aeef4cb3e94389a148a3a809b7e495/users/8ff4122a50d74f74a83d6c81d001accb/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:25.923392 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:25.923788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:25.924169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:25.956820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] MFA Rules not processed for user `8ff4122a50d74f74a83d6c81d001accb`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:25.958574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:26.037474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1309/2615] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:26.048441 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:26.050391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:26.112825 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62451763-e313-4610-abaa-d4c0fca60d76 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:26.116839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:26.117456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:26.117741 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:26.118047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:26.127703 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:26.129149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:26.139401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1307/2616] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:26 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:26.192594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:26.194076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:26.201068 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:26.206833 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1989c-ff9e-4e92-a451-547b2febe78e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:26.210587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:26.211191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:26.211472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:26.211745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:26.270501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:26.271978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:26.287306 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1310/2617] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:27.467213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:27.468659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:27.538048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:27.542626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e7c94-24a9-4555-a13a-7fe7d4c9507a service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:27.548395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:27.548996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:27.549323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:27.549605 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] PATH_INFO: `/v3/users/47da043ec00e4b1d873267c39d0abcea` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:27.550844 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47da043ec00e4b1d873267c39d0abcea)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:27.552816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:27.726378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47da043ec00e4b1d873267c39d0abcea'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:27.727101 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47da043ec00e4b1d873267c39d0abcea'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:27.794704 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47da043ec00e4b1d873267c39d0abcea'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:27.803344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47da043ec00e4b1d873267c39d0abcea'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:27.815536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a59aac1-9832-4591-92b1-cd159a2ac9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47da043ec00e4b1d873267c39d0abcea'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:27.821696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1308/2618] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:27 2022] DELETE /identity/v3/users/47da043ec00e4b1d873267c39d0abcea => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:28.071286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:28.091208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64f78-4d93-4e00-804e-e82795bbad97 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:28.158554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:28.159194 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.159479 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.159757 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] PATH_INFO: `/v3/projects/915a41331fd64a6e949b1ebe5b8ade10` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.160896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915a41331fd64a6e949b1ebe5b8ade10)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:28.162844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:28.292120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915a41331fd64a6e949b1ebe5b8ade10', 'request_id': 'req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:28.300688 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915a41331fd64a6e949b1ebe5b8ade10', 'request_id': 'req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:28.304471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915a41331fd64a6e949b1ebe5b8ade10', 'request_id': 'req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:28.377625 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] The token cache is being invalidate because project 915a41331fd64a6e949b1ebe5b8ade10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:28.378216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:28.378611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-06ac5a2d-f28a-4a8a-ac30-86535041d3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:28.380136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1311/2619] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:28 2022] DELETE /identity/v3/projects/915a41331fd64a6e949b1ebe5b8ade10 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:28.385219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb9c3-34ef-461f-ad65-ab7cd13b59bd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.385592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb9c3-34ef-461f-ad65-ab7cd13b59bd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.385789 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb9c3-34ef-461f-ad65-ab7cd13b59bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.406434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8fecb9c3-34ef-461f-ad65-ab7cd13b59bd None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:28.408180 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8fecb9c3-34ef-461f-ad65-ab7cd13b59bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:28.470257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1309/2620] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:28.478899 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ab416-eda2-4241-bc38-45f18bca4fbf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.479243 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ab416-eda2-4241-bc38-45f18bca4fbf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.479527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ab416-eda2-4241-bc38-45f18bca4fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.500957 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f02ab416-eda2-4241-bc38-45f18bca4fbf None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:28.502418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f02ab416-eda2-4241-bc38-45f18bca4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:28.510327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1312/2621] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:28.514742 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb9c3-34ef-461f-ad65-ab7cd13b59bd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:28.525378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb9c3-34ef-461f-ad65-ab7cd13b59bd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:28.530052 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:28.532271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.532271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.532271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.532626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:28.532955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:28.534716 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:28.546603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1310/2622] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:16:28.552103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ab416-eda2-4241-bc38-45f18bca4fbf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:28.561566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ab416-eda2-4241-bc38-45f18bca4fbf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:28.566482 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:28.567224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.567509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.567783 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.568472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:28.578336 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:28.645827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1313/2623] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:28 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:28.647032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:28.657770 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2ccce-9524-40da-bfc5-551bae77746b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:28.714390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:28.714997 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.715285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.715565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.716203 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:28.718165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:28.735669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:28.824497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1311/2624] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:28 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:28.829510 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:28.835026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:28.840490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474be8a3-969e-4d77-bc3a-adcb5c9a759e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:28.846309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:28.846908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.847186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.847454 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.848209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:28.849709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:28.863318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1314/2625] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:28.864451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:28.874761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bc17a-ac44-4d60-86bd-d15298992323 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:28.879400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff67b8-99a5-4894-a1db-e99f6b56d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:28.879999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff67b8-99a5-4894-a1db-e99f6b56d793 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.880279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff67b8-99a5-4894-a1db-e99f6b56d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.880552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff67b8-99a5-4894-a1db-e99f6b56d793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.881189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff67b8-99a5-4894-a1db-e99f6b56d793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:28.882810 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff67b8-99a5-4894-a1db-e99f6b56d793 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:28.899044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1312/2626] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:28.902729 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:28.911943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1360e-d16d-43f3-9084-4256d49811f0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:28.917176 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:28.917864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:28.918152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:28.918505 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] PATH_INFO: `/v3/projects/07845d16e1a5428183029db4bfdca1a6/users/a8dff5d527d04a93a92dcb1b8e7da8b5/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:28.933239 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07845d16e1a5428183029db4bfdca1a6, user_id=a8dff5d527d04a93a92dcb1b8e7da8b5, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:28.936224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:29.000349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1315/2627] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:28 2022] PUT /identity/v3/projects/07845d16e1a5428183029db4bfdca1a6/users/a8dff5d527d04a93a92dcb1b8e7da8b5/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:29.011346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc594-a7e9-4cdf-a27c-576f7196ffde None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.011709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc594-a7e9-4cdf-a27c-576f7196ffde None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.012098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc594-a7e9-4cdf-a27c-576f7196ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.042900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-589cc594-a7e9-4cdf-a27c-576f7196ffde None None] MFA Rules not processed for user `a8dff5d527d04a93a92dcb1b8e7da8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:29.044109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-589cc594-a7e9-4cdf-a27c-576f7196ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:29.117013 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1313/2628] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:29.122017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:29.186086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ea9cc-ef17-48a8-9610-7adb948b12c6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:29.192268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:29.192991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.193371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.193651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.194438 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:29.196350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:29.357161 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1316/2629] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:29 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:29.362513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cc594-a7e9-4cdf-a27c-576f7196ffde None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:29.373698 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cc594-a7e9-4cdf-a27c-576f7196ffde None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:29.434269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:29.434886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.435165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.435440 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.436082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:29.438624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:29.527355 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1314/2630] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:29 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:29.531481 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:29.543579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de845e-f8d7-430d-ac4a-d99714c547e0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:29.549753 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:29.550408 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.550697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.553461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.553461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:29.553461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:29.565319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1317/2631] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:29.569496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:29.579674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab804cd-bd2e-49dd-9fd2-8244c9224a19 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:29.584362 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:29.585022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.585367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.585611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] PATH_INFO: `/v3/projects/80cab35eaa74430b8df5e0d1f8609b4e/users/c15af15f263246ccbcecf828252b1f69/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.601230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cab35eaa74430b8df5e0d1f8609b4e, user_id=c15af15f263246ccbcecf828252b1f69, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:29.603897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:29.669422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1315/2632] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:29 2022] PUT /identity/v3/projects/80cab35eaa74430b8df5e0d1f8609b4e/users/c15af15f263246ccbcecf828252b1f69/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:29.674325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:29.684817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1c168-62f8-435a-ac1c-cd33ef13a766 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:29.744848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046596eb-cacc-433e-bc0d-f6d176742140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:29.745462 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046596eb-cacc-433e-bc0d-f6d176742140 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.745896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046596eb-cacc-433e-bc0d-f6d176742140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.746182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046596eb-cacc-433e-bc0d-f6d176742140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.746811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046596eb-cacc-433e-bc0d-f6d176742140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:29.748387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046596eb-cacc-433e-bc0d-f6d176742140 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:29.759376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1318/2633] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:29.763803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:29.774995 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc66d77-7b4e-4d52-85d1-0509f0a6888a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:29.779919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:29.780573 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.782982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.782982 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] PATH_INFO: `/v3/projects/80cab35eaa74430b8df5e0d1f8609b4e/users/c15af15f263246ccbcecf828252b1f69/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.784008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cab35eaa74430b8df5e0d1f8609b4e, user_id=c15af15f263246ccbcecf828252b1f69, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:29.786751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:29.798159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1316/2634] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:29 2022] PUT /identity/v3/projects/80cab35eaa74430b8df5e0d1f8609b4e/users/c15af15f263246ccbcecf828252b1f69/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:29.810318 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20d57-206d-4ea6-800a-4a32e83633e2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.810690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20d57-206d-4ea6-800a-4a32e83633e2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.810966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f20d57-206d-4ea6-800a-4a32e83633e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:29.839553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f2f20d57-206d-4ea6-800a-4a32e83633e2 None None] MFA Rules not processed for user `c15af15f263246ccbcecf828252b1f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:29.840744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f2f20d57-206d-4ea6-800a-4a32e83633e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:29.867468 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:29.911033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1319/2635] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:29.923785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:29.924906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:29.956954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:29.987108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c76a-3585-4362-b84d-d6c823c582f0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:29.990761 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:29.991360 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:29.991638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:29.991907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:30.001923 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:30.003494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:30.014632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1317/2636] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:30.244116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20d57-206d-4ea6-800a-4a32e83633e2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:30.257032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f20d57-206d-4ea6-800a-4a32e83633e2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:30.260418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aee30-3071-46ce-a25c-6b097ed0f980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:30.261464 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aee30-3071-46ce-a25c-6b097ed0f980 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:30.261814 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aee30-3071-46ce-a25c-6b097ed0f980 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:30.262063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aee30-3071-46ce-a25c-6b097ed0f980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:30.324685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aee30-3071-46ce-a25c-6b097ed0f980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:30.326212 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aee30-3071-46ce-a25c-6b097ed0f980 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:30.336338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1320/2637] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:31.108734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:31.112650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:31.176282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535741a-e9b4-47b3-a023-ec45eb5b25fd service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:31.181058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:31.181733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:31.182073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:31.182348 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] PATH_INFO: `/v3/users/a77e1ce1c3474f0d86347e6fed95f7ca` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:31.183510 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77e1ce1c3474f0d86347e6fed95f7ca)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:31.185470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:31.451026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77e1ce1c3474f0d86347e6fed95f7ca'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:31.451707 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77e1ce1c3474f0d86347e6fed95f7ca'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:31.532275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77e1ce1c3474f0d86347e6fed95f7ca'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:31.540064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77e1ce1c3474f0d86347e6fed95f7ca'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:31.552504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77e1ce1c3474f0d86347e6fed95f7ca'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:31.558420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1318/2638] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:31 2022] DELETE /identity/v3/users/a77e1ce1c3474f0d86347e6fed95f7ca => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:31.564465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:31.564991 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:31.565273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:31.587522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:31.588778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:31.648453 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1321/2639] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:31.658413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:31.662024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:31.714608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:31.720783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd49580-a10f-4f1a-8eda-3104636beddf admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:31.724724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:31.725389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:31.726220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:31.726498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:31.739938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:31.741799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:31.757090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1319/2640] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:32.167890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:32.169353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:32.183442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43946eb5-7ab8-4487-a101-d5583042c557 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:32.188424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:32.189107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:32.189387 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:32.189661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] PATH_INFO: `/v3/projects/15c5dbc1cba54bc9bdf75a5ab141dc35` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:32.190854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c5dbc1cba54bc9bdf75a5ab141dc35)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:32.192906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:32.293162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c5dbc1cba54bc9bdf75a5ab141dc35', 'request_id': 'req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.299670 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:32.300965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c5dbc1cba54bc9bdf75a5ab141dc35', 'request_id': 'req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.309228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c5dbc1cba54bc9bdf75a5ab141dc35', 'request_id': 'req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.373436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] The token cache is being invalidate because project 15c5dbc1cba54bc9bdf75a5ab141dc35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:32.373807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.374512 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.377544 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1322/2641] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:32 2022] DELETE /identity/v3/projects/15c5dbc1cba54bc9bdf75a5ab141dc35 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:32.381470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:32.392015 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409d0de-926b-4740-aa36-b439b4fe3a8f service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:32.457779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:32.458531 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:32.458815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:32.459114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] PATH_INFO: `/v3/users/8ff4122a50d74f74a83d6c81d001accb` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:32.460271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff4122a50d74f74a83d6c81d001accb)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:32.462329 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:32.603192 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff4122a50d74f74a83d6c81d001accb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.603856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff4122a50d74f74a83d6c81d001accb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.657177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff4122a50d74f74a83d6c81d001accb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.664574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff4122a50d74f74a83d6c81d001accb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.682868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e4a728d0-2973-41de-a040-6244b760ed5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff4122a50d74f74a83d6c81d001accb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:32.683599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1320/2642] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:32 2022] DELETE /identity/v3/users/8ff4122a50d74f74a83d6c81d001accb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:33.054074 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:33.060955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:33.071024 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60821-ef0a-4a00-8748-23cd2a8e3c8b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:33.135221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:33.135897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.136335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.136536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] PATH_INFO: `/v3/projects/62aeef4cb3e94389a148a3a809b7e495` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.137791 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62aeef4cb3e94389a148a3a809b7e495)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:33.141645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:33.259042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62aeef4cb3e94389a148a3a809b7e495', 'request_id': 'req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:33.264532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62aeef4cb3e94389a148a3a809b7e495', 'request_id': 'req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:33.270796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62aeef4cb3e94389a148a3a809b7e495', 'request_id': 'req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:33.372715 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] The token cache is being invalidate because project 62aeef4cb3e94389a148a3a809b7e495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:33.373017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:33.373641 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2d1e0e1-ee97-40b4-9924-8db308ea4e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:33.375131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1323/2643] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:33 2022] DELETE /identity/v3/projects/62aeef4cb3e94389a148a3a809b7e495 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:33.381446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fc90-c26b-487d-a2cd-075ddad00479 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.382079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fc90-c26b-487d-a2cd-075ddad00479 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.382645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69fc90-c26b-487d-a2cd-075ddad00479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.403335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-da69fc90-c26b-487d-a2cd-075ddad00479 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:33.404543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-da69fc90-c26b-487d-a2cd-075ddad00479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:33.483305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1321/2644] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:33.492999 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1155f-cf33-451b-89b5-8f9339319896 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.493356 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1155f-cf33-451b-89b5-8f9339319896 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.495103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1155f-cf33-451b-89b5-8f9339319896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.515606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-18d1155f-cf33-451b-89b5-8f9339319896 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:33.516806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-18d1155f-cf33-451b-89b5-8f9339319896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:33.526169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1324/2645] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:33.530083 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69fc90-c26b-487d-a2cd-075ddad00479 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:33.541933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69fc90-c26b-487d-a2cd-075ddad00479 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:33.546886 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:33.548415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.548700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.549009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.549821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:33.550219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:33.551933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:33.555002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:33.566170 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1322/2646] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:33.570635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1155f-cf33-451b-89b5-8f9339319896 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:33.582062 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1155f-cf33-451b-89b5-8f9339319896 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:33.586742 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:33.587368 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.587713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.587922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.588564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:33.590519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:33.740470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1325/2647] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:33 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:33.744718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:33.755714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20348628-a19c-42a0-8e39-0274dc906719 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:33.812112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:33.812632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.813437 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.813796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.814416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:33.816452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:33.921815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1323/2648] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:33 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:33.924955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:33.935077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893be3c9-3604-4050-b21e-bb8a850d15d4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:33.941858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:33.941858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.941858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.941858 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.942264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:33.943149 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:33.952875 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1326/2649] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:33.957415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:33.967397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89f943-f5e9-42e4-b43a-a2711114a0cb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:33.972900 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d129a-0b94-48cb-994f-06816feba335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:33.973501 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d129a-0b94-48cb-994f-06816feba335 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:33.973807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d129a-0b94-48cb-994f-06816feba335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:33.974081 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d129a-0b94-48cb-994f-06816feba335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:33.974714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d129a-0b94-48cb-994f-06816feba335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:33.976585 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d129a-0b94-48cb-994f-06816feba335 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:33.987659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1324/2650] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:33.991412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:34.001950 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129370d0-a917-49ea-ab13-3fa97accf13d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:34.006631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:34.007264 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:34.007543 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:34.007815 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] PATH_INFO: `/v3/projects/7fe5ff511ba9489da684971e4afe5921/users/2ba191a938c5433d8d76ae92b4a4f26e/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:34.023033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe5ff511ba9489da684971e4afe5921, user_id=2ba191a938c5433d8d76ae92b4a4f26e, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:34.025723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:34.121130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1327/2651] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:33 2022] PUT /identity/v3/projects/7fe5ff511ba9489da684971e4afe5921/users/2ba191a938c5433d8d76ae92b4a4f26e/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:34.133796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:34.134305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:34.134869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:34.162852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] MFA Rules not processed for user `2ba191a938c5433d8d76ae92b4a4f26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:34.164053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:34.227363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1325/2652] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:34.247497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:34.249819 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:34.266331 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:34.310269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab6239-2b69-46d0-814c-a76d60a1f34d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:34.314394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b926e-2c1d-4e17-bcd1-36c0f62a24b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9685c8b244249b2d29f4612a3e5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:34.315274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b926e-2c1d-4e17-bcd1-36c0f62a24b0 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:34.315939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b926e-2c1d-4e17-bcd1-36c0f62a24b0 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:34.316287 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b926e-2c1d-4e17-bcd1-36c0f62a24b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:34.324467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b926e-2c1d-4e17-bcd1-36c0f62a24b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:34.325963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b926e-2c1d-4e17-bcd1-36c0f62a24b0 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:34.334852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1328/2653] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:36.598804 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:36.600371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:36.667683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af867-e82f-4a92-a0ea-b7e15c5d6fd2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:36.672679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:36.673365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:36.674470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:36.674798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] PATH_INFO: `/v3/users/2712e5046e4346e88f4fa3470decbdbd` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:36.676023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2712e5046e4346e88f4fa3470decbdbd)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:36.678292 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:36.684065 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:36.880785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2712e5046e4346e88f4fa3470decbdbd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:36.881451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2712e5046e4346e88f4fa3470decbdbd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:36.950194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2712e5046e4346e88f4fa3470decbdbd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:36.960765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2712e5046e4346e88f4fa3470decbdbd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:36.973096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2712e5046e4346e88f4fa3470decbdbd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:36.979621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1326/2654] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:36 2022] DELETE /identity/v3/users/2712e5046e4346e88f4fa3470decbdbd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:36.984133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:36.984601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:36.984700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:37.006626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:37.007884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:37.070130 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1329/2655] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:37.081200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:37.082655 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:37.150393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e1585-355f-4634-8e11-5d17b9f65643 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:37.154282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:37.154820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:37.155140 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:37.155416 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:37.166951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:37.168462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:37.182155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1327/2656] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:37.620301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:37.621731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:37.639211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9812267-6232-48e4-aa5d-f4b05f3f063e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:37.646123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:37.647692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:37.648092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:37.648475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] PATH_INFO: `/v3/projects/32dd7027a91240c098647c58c77ce063` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:37.650276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32dd7027a91240c098647c58c77ce063)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:37.652867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:38.111964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32dd7027a91240c098647c58c77ce063', 'request_id': 'req-6fefd06e-134c-4e15-a72f-5f47dca70a0f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.118211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32dd7027a91240c098647c58c77ce063', 'request_id': 'req-6fefd06e-134c-4e15-a72f-5f47dca70a0f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.124588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32dd7027a91240c098647c58c77ce063', 'request_id': 'req-6fefd06e-134c-4e15-a72f-5f47dca70a0f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.240500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] The token cache is being invalidate because project 32dd7027a91240c098647c58c77ce063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:38.246485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.246485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.246485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1330/2657] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:37 2022] DELETE /identity/v3/projects/32dd7027a91240c098647c58c77ce063 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:38.249286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:38.259732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd63302-b166-4ae8-b122-4ca73312e2fe service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:38.323925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:38.324481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:38.324767 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:38.325042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] PATH_INFO: `/v3/users/ccd5706ceaf34d6baa89e6810d2ccae5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:38.326206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd5706ceaf34d6baa89e6810d2ccae5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:38.332608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:38.407940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:38.555148 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd5706ceaf34d6baa89e6810d2ccae5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.555957 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd5706ceaf34d6baa89e6810d2ccae5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.652211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd5706ceaf34d6baa89e6810d2ccae5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.660722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd5706ceaf34d6baa89e6810d2ccae5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.675109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd5706ceaf34d6baa89e6810d2ccae5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:38.681783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1328/2658] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:38 2022] DELETE /identity/v3/users/ccd5706ceaf34d6baa89e6810d2ccae5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:39.157502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.159970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:39.174435 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd06e-134c-4e15-a72f-5f47dca70a0f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.224893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:39.247585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.248217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.248503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.248778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] PATH_INFO: `/v3/projects/97d1f36184b442b194b4875246c24de1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.249931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d1f36184b442b194b4875246c24de1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:39.252150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:39.391058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d1f36184b442b194b4875246c24de1', 'request_id': 'req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.397273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d1f36184b442b194b4875246c24de1', 'request_id': 'req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.403769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d1f36184b442b194b4875246c24de1', 'request_id': 'req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.438679 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.440702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:39.453599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6bc4f-0eb5-47fd-823a-3d7ad210b23e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.481201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] The token cache is being invalidate because project 97d1f36184b442b194b4875246c24de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:39.483770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.483770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b1c339c-91e1-458e-bc7e-30ab6cd8278b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.488044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1331/2659] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:39 2022] DELETE /identity/v3/projects/97d1f36184b442b194b4875246c24de1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:39.489274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a41e0-80fe-485d-9747-9e30f37e0b85 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.489562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a41e0-80fe-485d-9747-9e30f37e0b85 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.489871 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a41e0-80fe-485d-9747-9e30f37e0b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.511788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-930a41e0-80fe-485d-9747-9e30f37e0b85 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:39.513201 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-930a41e0-80fe-485d-9747-9e30f37e0b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:39.515774 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.516413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.516699 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.517009 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] PATH_INFO: `/v3/users/a8dff5d527d04a93a92dcb1b8e7da8b5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.518383 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8dff5d527d04a93a92dcb1b8e7da8b5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:39.520343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:39.523103 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1332/2660] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:39.535064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a942a-a511-4674-bc45-27fb18187188 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.535345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a942a-a511-4674-bc45-27fb18187188 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.535617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a942a-a511-4674-bc45-27fb18187188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.555578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ff7a942a-a511-4674-bc45-27fb18187188 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:39.558692 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ff7a942a-a511-4674-bc45-27fb18187188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:39.567524 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1333/2661] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:39.572734 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a942a-a511-4674-bc45-27fb18187188 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.583485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a942a-a511-4674-bc45-27fb18187188 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.588197 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.588804 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.589086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.589363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.590147 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:39.590456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:39.592060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:39.604077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1334/2662] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:16:39.608440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.619014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4adb1-1ccf-493a-9d63-4cf457bb7521 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.624137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.624307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.624457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.624730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.625349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:39.628347 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:39.688917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8dff5d527d04a93a92dcb1b8e7da8b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.690068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8dff5d527d04a93a92dcb1b8e7da8b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.705617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1335/2663] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:39 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:39.709789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.760187 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8dff5d527d04a93a92dcb1b8e7da8b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.768796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8dff5d527d04a93a92dcb1b8e7da8b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.776376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617938f-226b-4402-973d-ea67cd2e1d43 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.781191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.784772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-65b32bed-1667-4931-a463-9712c173f8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8dff5d527d04a93a92dcb1b8e7da8b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:39.784951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.784951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.784951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.784951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:39.784951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:39.787739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1329/2664] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:39 2022] DELETE /identity/v3/users/a8dff5d527d04a93a92dcb1b8e7da8b5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:39.792044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.792335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.792615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.811645 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:39.822000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:39.831937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:39.875245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1330/2665] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:39.875463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1336/2666] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:39 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:39.880652 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.882064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:39.888131 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.890743 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:39.898681 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926106c-a181-4172-8594-7d6068eb0945 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.902329 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:39.905322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.906264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.906692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.907108 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.908129 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:39.910697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:39.928395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1331/2667] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:39.932280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.943572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d93d5-372c-47a8-8cb0-28bc16b5c574 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.949053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.951574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.951574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.951574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:39.951574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:39.952541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:39.960053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b0435-12ab-4cfc-9500-f4acc84694cd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.966615 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1332/2668] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:39.967633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:39.977541 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f133c-f2df-41ec-8bda-ef42e8ecfc92 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:39.982264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:39.982934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:39.983330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:39.983602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] PATH_INFO: `/v3/projects/ff68718085594ff5afc58affdff6027f/users/e98605628e5748a086bb3b84a660eef7/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.001286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff68718085594ff5afc58affdff6027f, user_id=e98605628e5748a086bb3b84a660eef7, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.004582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.012889 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe0c8c-1a70-420c-b226-aa7dd467106e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.013502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0c8c-1a70-420c-b226-aa7dd467106e service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.013810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0c8c-1a70-420c-b226-aa7dd467106e service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.014097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe0c8c-1a70-420c-b226-aa7dd467106e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.023442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe0c8c-1a70-420c-b226-aa7dd467106e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.025136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe0c8c-1a70-420c-b226-aa7dd467106e service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.039376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1337/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:40.087626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1333/2670] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:39 2022] PUT /identity/v3/projects/ff68718085594ff5afc58affdff6027f/users/e98605628e5748a086bb3b84a660eef7/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:40.098218 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1405215-dc2a-4780-af0f-bdabab6bd0f2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.098612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1405215-dc2a-4780-af0f-bdabab6bd0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.098964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1405215-dc2a-4780-af0f-bdabab6bd0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.133229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a1405215-dc2a-4780-af0f-bdabab6bd0f2 None None] MFA Rules not processed for user `e98605628e5748a086bb3b84a660eef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:40.134750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a1405215-dc2a-4780-af0f-bdabab6bd0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:40.202120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1338/2671] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:40.213453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.284432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18930-79a4-4408-b00d-cadf6c4e5534 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.289635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.290322 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.290599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.290870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.291497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.294325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.402328 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1334/2672] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:40 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:40.406525 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1405215-dc2a-4780-af0f-bdabab6bd0f2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.417857 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1405215-dc2a-4780-af0f-bdabab6bd0f2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.465503 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.467314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:40.470721 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:40.480457 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.481088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.481411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.481784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.485115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.485115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.547110 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad7e3e-a2a6-45d5-a84a-696226bec700 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.552427 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.553061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.553343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.553620 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] PATH_INFO: `/v3/projects/07845d16e1a5428183029db4bfdca1a6` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.554816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07845d16e1a5428183029db4bfdca1a6)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.556723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.563082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:40.576098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1339/2673] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:40 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:40.578476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.590371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ccc2e-3798-4a57-8da5-473c2fde92fe admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.595206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.595834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.596126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.596399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.597094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.598761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.612393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1340/2674] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:40.616704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.627757 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26cf9e-6516-4ad0-ab3c-97603cd33617 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.632465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.633107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.633389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.633661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] PATH_INFO: `/v3/projects/2017fd901fab421b8750f98142f8b281/users/c4aacef1da374875bb2643fb71a9a70f/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.648765 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2017fd901fab421b8750f98142f8b281, user_id=c4aacef1da374875bb2643fb71a9a70f, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.651452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.767441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1341/2675] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:40 2022] PUT /identity/v3/projects/2017fd901fab421b8750f98142f8b281/users/c4aacef1da374875bb2643fb71a9a70f/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:40.771969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.777269 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07845d16e1a5428183029db4bfdca1a6', 'request_id': 'req-2c539dd8-b870-41ec-bf3d-bbbceb564663'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:40.783728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07845d16e1a5428183029db4bfdca1a6', 'request_id': 'req-2c539dd8-b870-41ec-bf3d-bbbceb564663'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:40.789466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07845d16e1a5428183029db4bfdca1a6', 'request_id': 'req-2c539dd8-b870-41ec-bf3d-bbbceb564663'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:40.836761 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fcd2d-4645-4c72-a137-3a56a1e6d3dd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.839506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] The token cache is being invalidate because project 07845d16e1a5428183029db4bfdca1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:40.839794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:40.840414 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:40.842008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1335/2676] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:40 2022] DELETE /identity/v3/projects/07845d16e1a5428183029db4bfdca1a6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:40.846650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.848260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:40.903955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.903955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.904178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.904440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.905109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.906739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.914020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539dd8-b870-41ec-bf3d-bbbceb564663 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.916912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1342/2677] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:40.921237 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:40.922614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.923102 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:40.923426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.923714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.924008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] PATH_INFO: `/v3/users/c15af15f263246ccbcecf828252b1f69` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.926147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15af15f263246ccbcecf828252b1f69)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.928549 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.937490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164d6e3-5831-4f34-a4ab-bcacba2f6a18 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:40.943769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10142a37-7f64-4a92-ade8-7def2ce71c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:40.944452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10142a37-7f64-4a92-ade8-7def2ce71c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.944851 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10142a37-7f64-4a92-ade8-7def2ce71c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.945016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10142a37-7f64-4a92-ade8-7def2ce71c84 admin admin] PATH_INFO: `/v3/projects/2017fd901fab421b8750f98142f8b281/users/c4aacef1da374875bb2643fb71a9a70f/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:40.947020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10142a37-7f64-4a92-ade8-7def2ce71c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2017fd901fab421b8750f98142f8b281, user_id=c4aacef1da374875bb2643fb71a9a70f, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:40.949748 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10142a37-7f64-4a92-ade8-7def2ce71c84 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:40.960842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1343/2678] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:40 2022] PUT /identity/v3/projects/2017fd901fab421b8750f98142f8b281/users/c4aacef1da374875bb2643fb71a9a70f/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:40.977371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:40.977661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:40.977970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:41.005890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] MFA Rules not processed for user `c4aacef1da374875bb2643fb71a9a70f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:41.007028 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:41.041823 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:41.079809 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1344/2679] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:41.092750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:41.094141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:41.101604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15af15f263246ccbcecf828252b1f69'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:41.102325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15af15f263246ccbcecf828252b1f69'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:41.159503 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3efe4-d1dc-43b0-8bee-79b02ffa8331 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:41.163167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:41.163770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:41.164090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:41.164362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:41.171688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15af15f263246ccbcecf828252b1f69'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:41.173326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:41.174906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:41.179483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15af15f263246ccbcecf828252b1f69'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:41.184848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1345/2680] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:41.203875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a85cfe52-fa57-40b7-9270-22dc2676c05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15af15f263246ccbcecf828252b1f69'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:41.211737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1336/2681] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:40 2022] DELETE /identity/v3/users/c15af15f263246ccbcecf828252b1f69 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:41.693484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:41.773017 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb39968-24e6-4154-b565-8ba07de46093 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:41.833954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:41.834582 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:41.834860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:41.835132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] PATH_INFO: `/v3/projects/80cab35eaa74430b8df5e0d1f8609b4e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:41.836242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cab35eaa74430b8df5e0d1f8609b4e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:41.838166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:41.859965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:41.977051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cab35eaa74430b8df5e0d1f8609b4e', 'request_id': 'req-b68fda46-821a-4af5-ac58-b87d59dc0606'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:41.983568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cab35eaa74430b8df5e0d1f8609b4e', 'request_id': 'req-b68fda46-821a-4af5-ac58-b87d59dc0606'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:41.990122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cab35eaa74430b8df5e0d1f8609b4e', 'request_id': 'req-b68fda46-821a-4af5-ac58-b87d59dc0606'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.087063 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] The token cache is being invalidate because project 80cab35eaa74430b8df5e0d1f8609b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:42.087268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.087892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b68fda46-821a-4af5-ac58-b87d59dc0606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.089370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1346/2682] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:41 2022] DELETE /identity/v3/projects/80cab35eaa74430b8df5e0d1f8609b4e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:42.094346 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798db1c-c1cb-47b1-a01d-2d1245ead0fd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.094816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798db1c-c1cb-47b1-a01d-2d1245ead0fd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.094919 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798db1c-c1cb-47b1-a01d-2d1245ead0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.116335 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9798db1c-c1cb-47b1-a01d-2d1245ead0fd None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:42.117528 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9798db1c-c1cb-47b1-a01d-2d1245ead0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:42.126224 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:42.178975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1337/2683] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:42.187135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442fdbd-b1e9-4db0-a97a-1829befb97bd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.187404 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442fdbd-b1e9-4db0-a97a-1829befb97bd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.187837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442fdbd-b1e9-4db0-a97a-1829befb97bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.208529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4442fdbd-b1e9-4db0-a97a-1829befb97bd None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:42.209786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4442fdbd-b1e9-4db0-a97a-1829befb97bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:42.218082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1347/2684] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:42.223029 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798db1c-c1cb-47b1-a01d-2d1245ead0fd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.233815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798db1c-c1cb-47b1-a01d-2d1245ead0fd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.239647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.240262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.240546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.240823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.241469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:42.241851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.243513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.262306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1338/2685] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:42.264109 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442fdbd-b1e9-4db0-a97a-1829befb97bd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.270943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.272712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:42.275696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442fdbd-b1e9-4db0-a97a-1829befb97bd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.280400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.284936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.284936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.284936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.284936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.284936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.360594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566b67-d34e-4545-923d-a4d6c807372c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.366022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4aacef1da374875bb2643fb71a9a70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2017fd901fab421b8750f98142f8b281', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.366642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.366931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.367211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.367868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:42.368193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.369873 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.382820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1339/2686] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:16:42.386978 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.394268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1348/2687] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:42 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:42.395471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.397527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63829442-f371-420c-9beb-fe02ad27c9e5 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.465465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4aacef1da374875bb2643fb71a9a70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2017fd901fab421b8750f98142f8b281', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.466559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a29a-b091-49cd-b223-2edf4d5b81c5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.471257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.472416 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.472696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.473064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.473691 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.475643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.477925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.478273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.478567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.479368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.481422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.584343 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1349/2688] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:42 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:42.588187 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.599002 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e5f00-f9ad-4989-bafd-41235b7ec924 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.607059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1340/2689] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:42 2022] POST /identity/v3/projects => generated 353 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:42.607233 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.607747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.608162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.608284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.608762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.609984 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.622311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.633614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1350/2690] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:42.634815 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:42.637552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.648940 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b964681-1707-4661-93a3-92f04c827031 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.680818 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9c5bb-457a-4a58-8c42-9fca867f400d tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.686631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4aacef1da374875bb2643fb71a9a70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2017fd901fab421b8750f98142f8b281', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.687918 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.688218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.688506 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.689163 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:42.689477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.691931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.702448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:42.704542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1341/2691] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:42.710740 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.712012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.712012 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.712302 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.713405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.715191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.727384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1351/2692] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:42.731492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.743498 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed7532-354d-421a-b7c1-4e48d4b49738 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.748318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb100f8-1594-4e9b-866f-3799f1acdc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.748984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb100f8-1594-4e9b-866f-3799f1acdc15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.749265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb100f8-1594-4e9b-866f-3799f1acdc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.749493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.749609 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb100f8-1594-4e9b-866f-3799f1acdc15 admin admin] PATH_INFO: `/v3/projects/f0b217faac9b47e0b5dc3e1588407d88/users/22774ac3df2d4707bbcf47919dd9e1bd/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.760630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1053f3-e080-49b6-80a4-108e6060c27c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:42.766078 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb100f8-1594-4e9b-866f-3799f1acdc15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b217faac9b47e0b5dc3e1588407d88, user_id=22774ac3df2d4707bbcf47919dd9e1bd, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.766779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4aacef1da374875bb2643fb71a9a70f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2017fd901fab421b8750f98142f8b281', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:42.767528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.767827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.768104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] PATH_INFO: `/v3/projects/c38fa2b78e174aaaa45e08aa2195d442` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.768852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb100f8-1594-4e9b-866f-3799f1acdc15 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.769417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c38fa2b78e174aaaa45e08aa2195d442)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:42.771344 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:42.864218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1342/2693] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:42 2022] PUT /identity/v3/projects/f0b217faac9b47e0b5dc3e1588407d88/users/22774ac3df2d4707bbcf47919dd9e1bd/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:42.877515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23986f4-015d-49f7-98c9-d6af7d63b9f1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:42.877799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23986f4-015d-49f7-98c9-d6af7d63b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:42.878570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23986f4-015d-49f7-98c9-d6af7d63b9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:42.884269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38fa2b78e174aaaa45e08aa2195d442', 'request_id': 'req-4df867fc-b715-4828-b2c1-c22dd363acb6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.891170 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38fa2b78e174aaaa45e08aa2195d442', 'request_id': 'req-4df867fc-b715-4828-b2c1-c22dd363acb6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.900185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38fa2b78e174aaaa45e08aa2195d442', 'request_id': 'req-4df867fc-b715-4828-b2c1-c22dd363acb6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.906954 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e23986f4-015d-49f7-98c9-d6af7d63b9f1 None None] MFA Rules not processed for user `22774ac3df2d4707bbcf47919dd9e1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:42.908172 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e23986f4-015d-49f7-98c9-d6af7d63b9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:42.963338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] The token cache is being invalidate because project c38fa2b78e174aaaa45e08aa2195d442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:42.963638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.964290 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:42.965877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1352/2694] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:42 2022] DELETE /identity/v3/projects/c38fa2b78e174aaaa45e08aa2195d442 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:42.977211 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1343/2695] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:42.981586 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:42.983314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:43.056491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df867fc-b715-4828-b2c1-c22dd363acb6 tempest-VolumeQuotaClassesTest-1962689592 tempest-VolumeQuotaClassesTest-1962689592-project-admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.061425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.062094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.062373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.062645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.063284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.065228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.196774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1353/2696] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:42 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:43.200891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23986f4-015d-49f7-98c9-d6af7d63b9f1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:43.213263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23986f4-015d-49f7-98c9-d6af7d63b9f1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.272967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.273588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.273910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.274185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.274836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.276744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.363776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1344/2697] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:43 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:43.365178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:43.375513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d021ed2-31d9-48d0-9650-1a4748d04b57 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.381190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.381807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.382119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.382393 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.383032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.384607 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.395900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1354/2698] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:43.399654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:43.409754 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7923e6-53c2-4c66-b4f6-d1d105402972 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.414434 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.415085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.415370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.415651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] PATH_INFO: `/v3/projects/4409ac42e0314cd8b4946a982b43cc49/users/d2ee99b661254853b3a92b3a24fc9eae/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.418760 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:43.433401 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4409ac42e0314cd8b4946a982b43cc49, user_id=d2ee99b661254853b3a92b3a24fc9eae, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.436109 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.543539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1345/2699] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:43 2022] PUT /identity/v3/projects/4409ac42e0314cd8b4946a982b43cc49/users/d2ee99b661254853b3a92b3a24fc9eae/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:43.547738 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:43.557916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ca79-d8fc-47c0-8dc8-f0db05261107 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.607474 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:43.619501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.620122 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.620405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.620677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.621323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.623097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.633930 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1355/2700] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:43.638460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:43.649731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7e295-9e50-41ab-8eb4-9bbe921409bc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.655194 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcd892-87ca-430a-830e-86bb28e31f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.656310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd892-87ca-430a-830e-86bb28e31f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.656674 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:43.656803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd892-87ca-430a-830e-86bb28e31f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.657299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcd892-87ca-430a-830e-86bb28e31f08 admin admin] PATH_INFO: `/v3/projects/4409ac42e0314cd8b4946a982b43cc49/users/d2ee99b661254853b3a92b3a24fc9eae/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.658497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:43.660400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcd892-87ca-430a-830e-86bb28e31f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4409ac42e0314cd8b4946a982b43cc49, user_id=d2ee99b661254853b3a92b3a24fc9eae, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.664354 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcd892-87ca-430a-830e-86bb28e31f08 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.672618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e16ed-390f-4575-96b8-fec40af32382 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.676590 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1346/2701] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:43 2022] PUT /identity/v3/projects/4409ac42e0314cd8b4946a982b43cc49/users/d2ee99b661254853b3a92b3a24fc9eae/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:43.686673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.686961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.687236 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.726477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] MFA Rules not processed for user `d2ee99b661254853b3a92b3a24fc9eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:43.727588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:43.736601 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.738323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.738323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.738516 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] PATH_INFO: `/v3/users/e98605628e5748a086bb3b84a660eef7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.739673 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98605628e5748a086bb3b84a660eef7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.741595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.807536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1347/2702] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:43.819468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:43.823069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:43.878862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa1828-42c5-4f91-8a6d-f2e07a661da4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:43.883218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e2ed1-efec-4d20-89fd-eeb59e06e0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:43.883983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e2ed1-efec-4d20-89fd-eeb59e06e0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:43.884273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e2ed1-efec-4d20-89fd-eeb59e06e0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:43.884553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e2ed1-efec-4d20-89fd-eeb59e06e0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:43.895788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e2ed1-efec-4d20-89fd-eeb59e06e0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:43.897264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e2ed1-efec-4d20-89fd-eeb59e06e0f2 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:43.907216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1348/2703] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:43.918221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98605628e5748a086bb3b84a660eef7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:43.990235 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98605628e5748a086bb3b84a660eef7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:43.999358 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98605628e5748a086bb3b84a660eef7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.000493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98605628e5748a086bb3b84a660eef7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.015918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98605628e5748a086bb3b84a660eef7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.023918 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1356/2704] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:43 2022] DELETE /identity/v3/users/e98605628e5748a086bb3b84a660eef7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:44.030884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57229870-a722-4959-9621-74eea86e171b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:44.030884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57229870-a722-4959-9621-74eea86e171b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:44.030884 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57229870-a722-4959-9621-74eea86e171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:44.050529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-57229870-a722-4959-9621-74eea86e171b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:44.051902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-57229870-a722-4959-9621-74eea86e171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:44.115629 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:44.124031 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1349/2705] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:44.134132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:44.135534 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:44.200397 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0e63-c14c-4af1-b9f3-f5447cf4eb98 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:44.204029 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:44.204632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:44.204915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:44.205188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:44.214632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:44.216070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:44.226766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1357/2706] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:44.693865 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57229870-a722-4959-9621-74eea86e171b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:44.696127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-57229870-a722-4959-9621-74eea86e171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:44.710468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57229870-a722-4959-9621-74eea86e171b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:44.715276 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:44.715962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:44.719389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:44.719389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] PATH_INFO: `/v3/projects/ff68718085594ff5afc58affdff6027f` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:44.719389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff68718085594ff5afc58affdff6027f)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:44.719715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:44.883121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff68718085594ff5afc58affdff6027f', 'request_id': 'req-89ea0741-3bfa-4a11-b991-2465a58318b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.889751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff68718085594ff5afc58affdff6027f', 'request_id': 'req-89ea0741-3bfa-4a11-b991-2465a58318b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.896260 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff68718085594ff5afc58affdff6027f', 'request_id': 'req-89ea0741-3bfa-4a11-b991-2465a58318b2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.960471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] The token cache is being invalidate because project ff68718085594ff5afc58affdff6027f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:44.966071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.966071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:44.966071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1350/2707] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:44 2022] DELETE /identity/v3/projects/ff68718085594ff5afc58affdff6027f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:44.966904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:44.976847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d746f-7a34-4287-9658-e620bdf38aa5 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:44.983381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:44.984179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:44.984811 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:45.038635 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:45.039288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:45.039576 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:45.039860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] PATH_INFO: `/v3/users/c4aacef1da374875bb2643fb71a9a70f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:45.041293 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4aacef1da374875bb2643fb71a9a70f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:45.042975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:45.052837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea0741-3bfa-4a11-b991-2465a58318b2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:45.057697 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:45.058364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:45.058649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:45.058928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] PATH_INFO: `/v3/users/22774ac3df2d4707bbcf47919dd9e1bd` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:45.060076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22774ac3df2d4707bbcf47919dd9e1bd)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:45.062047 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:45.260857 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22774ac3df2d4707bbcf47919dd9e1bd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.261586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22774ac3df2d4707bbcf47919dd9e1bd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.262229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4aacef1da374875bb2643fb71a9a70f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.372260 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4aacef1da374875bb2643fb71a9a70f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.380979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4aacef1da374875bb2643fb71a9a70f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.386092 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4aacef1da374875bb2643fb71a9a70f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.394253 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a6cb590-3a64-4f10-a3ff-376efd220cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4aacef1da374875bb2643fb71a9a70f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.400371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1358/2708] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:44 2022] DELETE /identity/v3/users/c4aacef1da374875bb2643fb71a9a70f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:45.451798 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22774ac3df2d4707bbcf47919dd9e1bd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.459572 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22774ac3df2d4707bbcf47919dd9e1bd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.472459 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22774ac3df2d4707bbcf47919dd9e1bd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:45.479462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1351/2709] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:44 2022] DELETE /identity/v3/users/22774ac3df2d4707bbcf47919dd9e1bd => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:45.485298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:45.485586 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:45.485891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:45.506491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:45.510124 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:45.570048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1359/2710] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:45.584524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:45.584866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:45.590596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:45.660375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06af4f3-85d0-4b5e-9db5-21bbced2972e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:45.664275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:45.664990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:45.665336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:45.665673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:45.676808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:45.678280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:45.688308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1352/2711] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:46.073995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.073995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:46.087964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329b645-ac64-4840-aa7a-e1753a0ad963 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.096326 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.098753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:46.102276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.103096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.103528 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.103786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] PATH_INFO: `/v3/projects/2017fd901fab421b8750f98142f8b281` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.105105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2017fd901fab421b8750f98142f8b281)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.107175 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:46.114599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c9482-4a44-4dba-9faa-a0d1af68badd service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.121300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.122223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.122814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.122948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] PATH_INFO: `/v3/projects/f0b217faac9b47e0b5dc3e1588407d88` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.129390 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b217faac9b47e0b5dc3e1588407d88)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.134021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:46.138181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:46.288163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2017fd901fab421b8750f98142f8b281', 'request_id': 'req-71ae554f-e29b-4830-b056-05c394c90530'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.293071 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b217faac9b47e0b5dc3e1588407d88', 'request_id': 'req-fefcfed7-91cb-4afe-bb57-e268751ca0b0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.294044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2017fd901fab421b8750f98142f8b281', 'request_id': 'req-71ae554f-e29b-4830-b056-05c394c90530'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.300155 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b217faac9b47e0b5dc3e1588407d88', 'request_id': 'req-fefcfed7-91cb-4afe-bb57-e268751ca0b0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.300919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2017fd901fab421b8750f98142f8b281', 'request_id': 'req-71ae554f-e29b-4830-b056-05c394c90530'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.306069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b217faac9b47e0b5dc3e1588407d88', 'request_id': 'req-fefcfed7-91cb-4afe-bb57-e268751ca0b0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.395263 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] The token cache is being invalidate because project 2017fd901fab421b8750f98142f8b281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:46.395560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.396309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71ae554f-e29b-4830-b056-05c394c90530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.397878 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1360/2712] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:46 2022] DELETE /identity/v3/projects/2017fd901fab421b8750f98142f8b281 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:46.402615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc1b3-da54-4da7-b9e5-a47bb553b3d5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.402902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc1b3-da54-4da7-b9e5-a47bb553b3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.403177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adc1b3-da54-4da7-b9e5-a47bb553b3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.424252 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-62adc1b3-da54-4da7-b9e5-a47bb553b3d5 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:46.425638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-62adc1b3-da54-4da7-b9e5-a47bb553b3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:46.468828 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] The token cache is being invalidate because project f0b217faac9b47e0b5dc3e1588407d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:46.469142 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.469866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.471685 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1353/2713] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:46 2022] DELETE /identity/v3/projects/f0b217faac9b47e0b5dc3e1588407d88 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:46.475470 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.477216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:46.484915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1361/2714] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:46.490659 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcfed7-91cb-4afe-bb57-e268751ca0b0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.493546 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430ccc-233d-4f5b-8d13-a74782558d38 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.493886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430ccc-233d-4f5b-8d13-a74782558d38 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.494167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430ccc-233d-4f5b-8d13-a74782558d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.495641 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.496309 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.496581 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.496856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] PATH_INFO: `/v3/users/d2ee99b661254853b3a92b3a24fc9eae` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.498028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ee99b661254853b3a92b3a24fc9eae)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.499913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:46.514602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-59430ccc-233d-4f5b-8d13-a74782558d38 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:46.515811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-59430ccc-233d-4f5b-8d13-a74782558d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:46.524553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1362/2715] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:46.528488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430ccc-233d-4f5b-8d13-a74782558d38 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.537585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430ccc-233d-4f5b-8d13-a74782558d38 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.542291 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.542817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.543101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.543373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.544011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:46.544315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.545923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:46.557286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1363/2716] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:16:46.561355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.571409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b930be-48ab-4160-90f8-7d3b9807abb9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.581326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.581326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.581326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.581326 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.581694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.581694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:46.687820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1364/2717] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:46 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:46.691682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.729428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ee99b661254853b3a92b3a24fc9eae'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.734996 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ee99b661254853b3a92b3a24fc9eae'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.762603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb2a6a-cb5f-4a49-b916-0dcbcfaefa76 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.767296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.767897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.768895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.769167 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.769822 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.771836 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:46.811446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ee99b661254853b3a92b3a24fc9eae'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.818882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ee99b661254853b3a92b3a24fc9eae'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.831496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ee99b661254853b3a92b3a24fc9eae'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:46.833867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:46.837981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1354/2718] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:46 2022] DELETE /identity/v3/users/d2ee99b661254853b3a92b3a24fc9eae => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:46.876558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:46.884395 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1365/2719] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:46 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:46.885734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.888044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:46.952790 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd60b88-b52e-4716-aa8e-a44898ad3a18 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.958061 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.958663 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.958942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.959212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.959846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.961421 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:46.972361 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1355/2720] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:46.977043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:46.988536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d712950-d1f0-4a3f-ba95-7f8b61368dd5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:46.994349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e736ab7-833a-45d4-a226-6f105efbbfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:46.994974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e736ab7-833a-45d4-a226-6f105efbbfcd admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:46.995259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e736ab7-833a-45d4-a226-6f105efbbfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:46.995536 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e736ab7-833a-45d4-a226-6f105efbbfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:46.996221 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e736ab7-833a-45d4-a226-6f105efbbfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:46.997883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e736ab7-833a-45d4-a226-6f105efbbfcd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.009007 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1366/2721] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:47.013105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.024321 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae30b-2ba8-466c-b5e5-9cbf536d597c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.029303 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.029998 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.030304 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.030578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] PATH_INFO: `/v3/projects/659eb36f17de4a9a82bff516fc975b28/users/f0b81b433d4a46db9a4e8144df3e3e85/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.052684 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659eb36f17de4a9a82bff516fc975b28, user_id=f0b81b433d4a46db9a4e8144df3e3e85, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.055483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.166592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1356/2722] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:47 2022] PUT /identity/v3/projects/659eb36f17de4a9a82bff516fc975b28/users/f0b81b433d4a46db9a4e8144df3e3e85/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:47.176961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f2b23-54ce-4917-ba13-45ede717637c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.177440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f2b23-54ce-4917-ba13-45ede717637c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.177551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f2b23-54ce-4917-ba13-45ede717637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.206776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-de2f2b23-54ce-4917-ba13-45ede717637c None None] MFA Rules not processed for user `f0b81b433d4a46db9a4e8144df3e3e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:47.207877 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-de2f2b23-54ce-4917-ba13-45ede717637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:47.259882 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.261856 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:47.275266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1367/2723] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:47.280867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f2b23-54ce-4917-ba13-45ede717637c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.337484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec1864-e4fe-4fda-807f-22b4f0723237 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.342125 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.342752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.343036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.343314 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] PATH_INFO: `/v3/projects/4409ac42e0314cd8b4946a982b43cc49` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.344455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4409ac42e0314cd8b4946a982b43cc49)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.346489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.347357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f2b23-54ce-4917-ba13-45ede717637c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.352301 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.352908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.353203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.353600 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.354274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.356214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.446838 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4409ac42e0314cd8b4946a982b43cc49', 'request_id': 'req-ca145edd-7f5e-4d00-9622-c84ed76f123b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:47.452915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4409ac42e0314cd8b4946a982b43cc49', 'request_id': 'req-ca145edd-7f5e-4d00-9622-c84ed76f123b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:47.458578 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4409ac42e0314cd8b4946a982b43cc49', 'request_id': 'req-ca145edd-7f5e-4d00-9622-c84ed76f123b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:47.470150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1368/2724] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:47.474082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.535701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db475e-37ce-40fc-977f-ccbe166db353 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.540338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.540935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.541214 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.541486 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.542137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.544042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.554967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:47.577111 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] The token cache is being invalidate because project 4409ac42e0314cd8b4946a982b43cc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:47.577415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:47.578069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ca145edd-7f5e-4d00-9622-c84ed76f123b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:47.579626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1357/2725] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:47 2022] DELETE /identity/v3/projects/4409ac42e0314cd8b4946a982b43cc49 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:47.584446 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d9bdd-71cc-4ff7-b9bf-dd293037e125 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.584730 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d9bdd-71cc-4ff7-b9bf-dd293037e125 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.585023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d9bdd-71cc-4ff7-b9bf-dd293037e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.592576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:47.605367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9e6d9bdd-71cc-4ff7-b9bf-dd293037e125 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:47.606667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9e6d9bdd-71cc-4ff7-b9bf-dd293037e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:47.615685 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1358/2726] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:47.623529 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4dd3b-c940-41da-a15c-b7e0102dae99 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.623841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4dd3b-c940-41da-a15c-b7e0102dae99 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.624112 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4dd3b-c940-41da-a15c-b7e0102dae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.641138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1369/2727] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:47.645186 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.645883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-46f4dd3b-c940-41da-a15c-b7e0102dae99 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:47.646845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:47.647067 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-46f4dd3b-c940-41da-a15c-b7e0102dae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:47.655252 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1359/2728] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:47.659710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4dd3b-c940-41da-a15c-b7e0102dae99 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.662266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52238963-b03d-4fdb-a386-6727486cc774 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.667052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.668646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.668646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.668646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.668970 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.669064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4dd3b-c940-41da-a15c-b7e0102dae99 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.670660 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.673739 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.674870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.675492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.675492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.676134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:47.676439 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.678046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.681922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1370/2729] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:47.685938 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.689948 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1360/2730] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:16:47.695330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.696924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e8c8-b9fb-417c-8385-bf30c5958181 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.701731 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.702418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.704022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.704022 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] PATH_INFO: `/v3/projects/e3e1b7b7f05a4748a858e03db385f66a/users/d7b37c1a7f074572a9d643377868f5a4/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.705990 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675229eb-a4e4-4388-b672-fa0ae0c1d0a2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.710891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.711489 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.711778 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.712087 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.712720 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.714747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.719025 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e1b7b7f05a4748a858e03db385f66a, user_id=d7b37c1a7f074572a9d643377868f5a4, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.722405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.812229 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1371/2731] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:47 2022] PUT /identity/v3/projects/e3e1b7b7f05a4748a858e03db385f66a/users/d7b37c1a7f074572a9d643377868f5a4/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:47.815666 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1361/2732] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:47.816776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.817852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.880555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb657a14-541e-4d64-8bec-d53904999396 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.881147 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ba9c-4f42-47fe-b6a8-6f27baded9ce admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.885420 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.885711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.886114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.886341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.886456 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.886672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.886783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.886976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.887341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.887600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.889001 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.889473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.900371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1372/2733] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:47.905084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:47.914016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7f0d-d9ed-4a54-ab3d-16afaec80995 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:47.918659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473958d-0b20-49f5-ab6b-55fa3f6dfe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:47.919324 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473958d-0b20-49f5-ab6b-55fa3f6dfe4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.919609 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473958d-0b20-49f5-ab6b-55fa3f6dfe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.919916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473958d-0b20-49f5-ab6b-55fa3f6dfe4b admin admin] PATH_INFO: `/v3/projects/e3e1b7b7f05a4748a858e03db385f66a/users/d7b37c1a7f074572a9d643377868f5a4/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.921883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473958d-0b20-49f5-ab6b-55fa3f6dfe4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e1b7b7f05a4748a858e03db385f66a, user_id=d7b37c1a7f074572a9d643377868f5a4, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:47.924631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473958d-0b20-49f5-ab6b-55fa3f6dfe4b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:47.934675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1373/2734] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:47 2022] PUT /identity/v3/projects/e3e1b7b7f05a4748a858e03db385f66a/users/d7b37c1a7f074572a9d643377868f5a4/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:47.946134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:47.946417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:47.946697 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:47.975500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] MFA Rules not processed for user `d7b37c1a7f074572a9d643377868f5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:47.976966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:48.007826 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1362/2735] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:48.011967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.026411 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d608f-2bc0-4e7f-93f9-5b4ae5d4162c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.048419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1374/2736] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:48.059852 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.061584 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:48.086903 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.087649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.088026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.088398 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.089481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.090972 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.094008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:48.103639 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1363/2737] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:48.108751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.117592 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63c6be-48b1-46b1-b1dd-b9f5d0d11b3d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.122193 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.122787 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.123130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.123338 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.123966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.124125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3246f-3c26-42e6-ac88-4776c076899f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.125569 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.129298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6992e-7703-438a-a0ab-cda95db7e191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.130219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6992e-7703-438a-a0ab-cda95db7e191 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.136082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6992e-7703-438a-a0ab-cda95db7e191 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.136082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6992e-7703-438a-a0ab-cda95db7e191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.137230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1364/2738] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:48.141305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.142542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6992e-7703-438a-a0ab-cda95db7e191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.144714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6992e-7703-438a-a0ab-cda95db7e191 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.151466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c80b4-1c8c-44cc-b0ef-5dc8270f617b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.154569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1375/2739] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:48.158216 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.159020 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.159582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.159869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] PATH_INFO: `/v3/projects/a0c7477caff24d479df491e06da819c9/users/1ccbfead682a496f83f4f5ef633a4032/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.177311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c7477caff24d479df491e06da819c9, user_id=1ccbfead682a496f83f4f5ef633a4032, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.179986 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.263523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1365/2740] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:48 2022] PUT /identity/v3/projects/a0c7477caff24d479df491e06da819c9/users/1ccbfead682a496f83f4f5ef633a4032/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:48.279312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cf8a5-0888-4c55-aa3c-70a9c781ccbf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.279812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cf8a5-0888-4c55-aa3c-70a9c781ccbf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.279969 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cf8a5-0888-4c55-aa3c-70a9c781ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.310412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-341cf8a5-0888-4c55-aa3c-70a9c781ccbf None None] MFA Rules not processed for user `1ccbfead682a496f83f4f5ef633a4032`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:48.311618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-341cf8a5-0888-4c55-aa3c-70a9c781ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:48.379681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1376/2741] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:48.387474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.393989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:48.454053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cc363-70ea-4889-a5e8-e755d7465738 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.459748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.460547 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.460989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.461302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.461999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.463894 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.561875 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1366/2742] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:48 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:48.566762 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cf8a5-0888-4c55-aa3c-70a9c781ccbf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.577603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cf8a5-0888-4c55-aa3c-70a9c781ccbf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.635026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.635623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.635908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.636185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.636867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.638784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.666033 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.676551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56914c9c-a6ae-472c-8a0a-12dfdb8346f9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.681185 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.682938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.682938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.682938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] PATH_INFO: `/v3/users/f0b81b433d4a46db9a4e8144df3e3e85` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.683658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b81b433d4a46db9a4e8144df3e3e85)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.685635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.738083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1377/2743] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:48 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:48.742093 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.751643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc360ccc-d84a-4ac8-8731-3e98e4fe7d18 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.757284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.757928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.758195 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.758527 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.759158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.760792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.771241 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1378/2744] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:48.775119 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.788953 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb9d8-b306-4af7-a194-496fe3306a3e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.793811 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.796211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.796211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.796211 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] PATH_INFO: `/v3/projects/3ef73bc0829e41e4bf8e7ca7bef570f1/users/09b7a2315649435eb93fc89d0dbe25c0/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.810108 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef73bc0829e41e4bf8e7ca7bef570f1, user_id=09b7a2315649435eb93fc89d0dbe25c0, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.812892 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.903286 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1379/2745] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:48 2022] PUT /identity/v3/projects/3ef73bc0829e41e4bf8e7ca7bef570f1/users/09b7a2315649435eb93fc89d0dbe25c0/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:48.907008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:48.920470 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:48.928651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b81b433d4a46db9a4e8144df3e3e85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:48.929312 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b81b433d4a46db9a4e8144df3e3e85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:48.968803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ce72-eb4f-497f-a53c-e6d604e2decc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:48.974242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:48.980278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:48.980278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:48.980278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:48.980278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:48.980278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:48.989551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1380/2746] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:48.993732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:49.000030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b81b433d4a46db9a4e8144df3e3e85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:49.006064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d519b7-1ab0-4dd6-913f-a13a461b5bab admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:49.014282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b81b433d4a46db9a4e8144df3e3e85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:49.014532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aaa989-a131-416b-b47d-80c844f7e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:49.014532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa989-a131-416b-b47d-80c844f7e071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:49.014532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa989-a131-416b-b47d-80c844f7e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:49.014532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aaa989-a131-416b-b47d-80c844f7e071 admin admin] PATH_INFO: `/v3/projects/3ef73bc0829e41e4bf8e7ca7bef570f1/users/09b7a2315649435eb93fc89d0dbe25c0/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:49.016483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaa989-a131-416b-b47d-80c844f7e071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef73bc0829e41e4bf8e7ca7bef570f1, user_id=09b7a2315649435eb93fc89d0dbe25c0, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:49.019554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aaa989-a131-416b-b47d-80c844f7e071 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:49.030654 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1381/2747] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:48 2022] PUT /identity/v3/projects/3ef73bc0829e41e4bf8e7ca7bef570f1/users/09b7a2315649435eb93fc89d0dbe25c0/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:49.041117 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-785fdd86-e456-4140-970e-6e4f29041123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b81b433d4a46db9a4e8144df3e3e85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:49.041268 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:49.041471 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:49.041885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:49.047920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1367/2748] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:48 2022] DELETE /identity/v3/users/f0b81b433d4a46db9a4e8144df3e3e85 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:49.057526 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:49.058231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:49.058231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:49.073401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] MFA Rules not processed for user `09b7a2315649435eb93fc89d0dbe25c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:49.075718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:49.081596 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:49.083025 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:49.150961 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1368/2749] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:49.157867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1382/2750] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:49.162063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:49.163428 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:49.167573 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:49.168537 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:49.169888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:49.223999 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b3daa-b409-4936-a872-bde04748b7c2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:49.229368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:49.230085 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:49.230433 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:49.230776 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:49.238026 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac7597-7205-411e-be5a-4bf58301f5f5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:49.243060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:49.243787 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:49.244078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:49.244357 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:49.245090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:49.246695 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:49.255039 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:49.256496 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:49.258246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1369/2751] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:49.269115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1383/2752] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:49.381425 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:49.390962 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597c88-1664-4bcc-81d4-9473c8234ae1 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:49.396044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:49.396044 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:49.396250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:49.396443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:49.398171 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:49.466337 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:49.468517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:49.478805 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1370/2753] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:49.722826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:49.724934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:49.740618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48a746-5d61-4f9e-9033-6ac189409be5 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:49.745376 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:49.746036 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:49.746320 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:49.746594 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] PATH_INFO: `/v3/projects/659eb36f17de4a9a82bff516fc975b28` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:49.747765 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659eb36f17de4a9a82bff516fc975b28)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:49.750189 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:49.774569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:49.893371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659eb36f17de4a9a82bff516fc975b28', 'request_id': 'req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:49.899113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659eb36f17de4a9a82bff516fc975b28', 'request_id': 'req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:49.905314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659eb36f17de4a9a82bff516fc975b28', 'request_id': 'req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.000069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] The token cache is being invalidate because project 659eb36f17de4a9a82bff516fc975b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:50.000296 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.000917 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.002452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1384/2754] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:49 2022] DELETE /identity/v3/projects/659eb36f17de4a9a82bff516fc975b28 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:50.006543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:50.017219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff64303-2393-49c6-8959-d4d83a6cfb0d service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:50.074392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:50.075027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:50.075310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:50.075583 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] PATH_INFO: `/v3/users/d7b37c1a7f074572a9d643377868f5a4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:50.076692 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b37c1a7f074572a9d643377868f5a4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:50.078726 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:50.344653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:50.346799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b37c1a7f074572a9d643377868f5a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.347513 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b37c1a7f074572a9d643377868f5a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.417816 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b37c1a7f074572a9d643377868f5a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.425496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b37c1a7f074572a9d643377868f5a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.437477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b37c1a7f074572a9d643377868f5a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.443554 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1371/2755] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:50 2022] DELETE /identity/v3/users/d7b37c1a7f074572a9d643377868f5a4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:50.532127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:50.532127 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:50.543439 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a00b2-0e81-436b-ac58-3b4114a82bd2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:50.601459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:50.602125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:50.602409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:50.602683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] PATH_INFO: `/v3/users/2ba191a938c5433d8d76ae92b4a4f26e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:50.603903 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba191a938c5433d8d76ae92b4a4f26e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:50.605856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:50.769614 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba191a938c5433d8d76ae92b4a4f26e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.817332 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba191a938c5433d8d76ae92b4a4f26e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.824879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba191a938c5433d8d76ae92b4a4f26e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.825521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba191a938c5433d8d76ae92b4a4f26e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.838905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8f927355-a8d1-45d6-8b93-6e34369aa177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba191a938c5433d8d76ae92b4a4f26e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:50.845452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1385/2756] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:50 2022] DELETE /identity/v3/users/2ba191a938c5433d8d76ae92b4a4f26e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:50.847273 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:50.849089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:50.850000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:50.850355 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:50.850698 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:50.863902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb667c6-da10-4ba0-b48d-a54b4d3d4ccd admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:50.871704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:50.873070 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:50.896923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:50.932536 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:50.933256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:50.933633 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:50.933947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] PATH_INFO: `/v3/projects/e3e1b7b7f05a4748a858e03db385f66a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:50.935069 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e1b7b7f05a4748a858e03db385f66a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:50.936152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1386/2757] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:50.937374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:50.946842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:50.948192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:51.005112 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599869f6-40d7-43f3-9138-7f910936f85e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.008704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47210635-c89a-4262-a703-6ebcce4b9bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.009307 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210635-c89a-4262-a703-6ebcce4b9bff service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.009589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210635-c89a-4262-a703-6ebcce4b9bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.009973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210635-c89a-4262-a703-6ebcce4b9bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.019498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47210635-c89a-4262-a703-6ebcce4b9bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.020923 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47210635-c89a-4262-a703-6ebcce4b9bff service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.030245 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1387/2758] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:51.064320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e1b7b7f05a4748a858e03db385f66a', 'request_id': 'req-f030a408-781b-4c82-a2d3-2147fe0623e9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.071279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e1b7b7f05a4748a858e03db385f66a', 'request_id': 'req-f030a408-781b-4c82-a2d3-2147fe0623e9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.076991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e1b7b7f05a4748a858e03db385f66a', 'request_id': 'req-f030a408-781b-4c82-a2d3-2147fe0623e9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.182493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] The token cache is being invalidate because project e3e1b7b7f05a4748a858e03db385f66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:51.182781 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.183397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f030a408-781b-4c82-a2d3-2147fe0623e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.184878 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1372/2759] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:50 2022] DELETE /identity/v3/projects/e3e1b7b7f05a4748a858e03db385f66a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:51.190693 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fcc28-499d-4e30-a8f6-92d4354e0065 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.191169 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fcc28-499d-4e30-a8f6-92d4354e0065 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.191444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fcc28-499d-4e30-a8f6-92d4354e0065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.211251 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-af3fcc28-499d-4e30-a8f6-92d4354e0065 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:51.212475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-af3fcc28-499d-4e30-a8f6-92d4354e0065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:51.285504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1388/2760] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:51.293021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081839b-2cc3-4f70-991f-2db4e95d4373 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.293305 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081839b-2cc3-4f70-991f-2db4e95d4373 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.293579 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081839b-2cc3-4f70-991f-2db4e95d4373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.319973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f081839b-2cc3-4f70-991f-2db4e95d4373 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:51.321443 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f081839b-2cc3-4f70-991f-2db4e95d4373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:51.331587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1373/2761] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:51.339042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fcc28-499d-4e30-a8f6-92d4354e0065 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.352236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fcc28-499d-4e30-a8f6-92d4354e0065 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.357465 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.358135 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.358417 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.358694 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.359402 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:51.359704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.361334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.373975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1389/2762] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:51.378415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081839b-2cc3-4f70-991f-2db4e95d4373 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.388036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081839b-2cc3-4f70-991f-2db4e95d4373 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.394396 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.395023 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.395281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.395551 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.396334 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.398285 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.505232 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.507508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:51.523077 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12b218-09da-461d-b0c2-c81026039169 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.528388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.529884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.529884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.530093 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1374/2763] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:51.530179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] PATH_INFO: `/v3/projects/7fe5ff511ba9489da684971e4afe5921` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.534318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.535425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe5ff511ba9489da684971e4afe5921)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.539352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.575279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:51.613371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313597eb-f883-4442-afbc-79b483c89179 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.618204 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.618820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.619102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.619375 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.620257 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.621959 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.670141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe5ff511ba9489da684971e4afe5921', 'request_id': 'req-fa6d4661-e284-48b1-b34a-20cc0912f67e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.672354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:51.677413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe5ff511ba9489da684971e4afe5921', 'request_id': 'req-fa6d4661-e284-48b1-b34a-20cc0912f67e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.684349 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe5ff511ba9489da684971e4afe5921', 'request_id': 'req-fa6d4661-e284-48b1-b34a-20cc0912f67e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.731607 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1375/2764] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:51.736143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.749545 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42c2ef-3a9d-4e8d-b0e4-a546cb522d3e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.762799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] The token cache is being invalidate because project 7fe5ff511ba9489da684971e4afe5921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:51.763553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.765879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fa6d4661-e284-48b1-b34a-20cc0912f67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:51.766613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1390/2765] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:51 2022] DELETE /identity/v3/projects/7fe5ff511ba9489da684971e4afe5921 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:51.772384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038246c0-a4b0-41bc-91f5-b24c158d50e7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.772976 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038246c0-a4b0-41bc-91f5-b24c158d50e7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.773075 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038246c0-a4b0-41bc-91f5-b24c158d50e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.792806 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-038246c0-a4b0-41bc-91f5-b24c158d50e7 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:51.796732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-038246c0-a4b0-41bc-91f5-b24c158d50e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:51.815637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.816279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.816556 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.820066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.820066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.820066 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.829523 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1376/2766] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:51.834143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.836392 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:51.852358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4128b65-7d31-4122-8be6-39409ed032f5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.856938 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.857640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.857776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1391/2767] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:51.858059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.858299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.859022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.860611 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.866949 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20e36-da5a-43c6-bb5f-66a8d4705ad0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.867240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20e36-da5a-43c6-bb5f-66a8d4705ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.867523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e20e36-da5a-43c6-bb5f-66a8d4705ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.872783 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1377/2768] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:16:51.880897 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.888579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-57e20e36-da5a-43c6-bb5f-66a8d4705ad0 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:51.889807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-57e20e36-da5a-43c6-bb5f-66a8d4705ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:51.890544 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726d458-4bf1-4d6a-8656-920366c2a052 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.895233 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07585af9-2041-4ddc-987f-ae36c80f5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.895867 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585af9-2041-4ddc-987f-ae36c80f5fba admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.896151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585af9-2041-4ddc-987f-ae36c80f5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.896422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07585af9-2041-4ddc-987f-ae36c80f5fba admin admin] PATH_INFO: `/v3/projects/dedb294f3d264cb393f3ac6d68162eac/users/613429b45d9841d58f44381156033964/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.900206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1392/2769] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:51.908703 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20e36-da5a-43c6-bb5f-66a8d4705ad0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.912168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07585af9-2041-4ddc-987f-ae36c80f5fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=dedb294f3d264cb393f3ac6d68162eac, user_id=613429b45d9841d58f44381156033964, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.915181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07585af9-2041-4ddc-987f-ae36c80f5fba admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.918289 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e20e36-da5a-43c6-bb5f-66a8d4705ad0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.922905 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.923498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.923783 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.924060 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.925883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:51.926196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.927795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.940683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1393/2770] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:16:51.945354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:51.955319 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342d242-39b8-4875-bfe7-7e9f82c5e516 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:51.961269 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:51.961902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.962184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.962513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:51.963133 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:51.965051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:51.989588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1378/2771] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:51 2022] PUT /identity/v3/projects/dedb294f3d264cb393f3ac6d68162eac/users/613429b45d9841d58f44381156033964/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:51.994637 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026566c-678c-40b5-955c-afa0572f286b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:51.994924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026566c-678c-40b5-955c-afa0572f286b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:51.995202 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026566c-678c-40b5-955c-afa0572f286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.014509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d026566c-678c-40b5-955c-afa0572f286b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:52.020841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d026566c-678c-40b5-955c-afa0572f286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:52.079485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1379/2772] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:52.089310 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026566c-678c-40b5-955c-afa0572f286b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:52.091157 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d026566c-678c-40b5-955c-afa0572f286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:52.093803 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1394/2773] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:51 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:52.097880 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:52.116608 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:52.179289 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026566c-678c-40b5-955c-afa0572f286b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:52.186603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf2f76-5326-4d6e-98d9-f7d60fa274a6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:52.195799 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:52.196578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:52.196978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:52.197467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.198498 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:52.200616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:52.235803 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:52.236415 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:52.236753 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:52.237521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.246992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:52.248442 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:52.258084 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1380/2774] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:52.336946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1395/2775] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:52 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:52.338120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:52.350457 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e195-2eac-46e7-bd24-8c01aa1780e7 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:52.355492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:52.356105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:52.356405 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:52.356662 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.357311 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:52.358943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:52.374262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1381/2776] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:52.375407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:52.386353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c28653-3712-4751-aa0b-916783b62dd3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:52.391278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fb064-18b8-44d3-8d80-7d4171eef14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:52.391967 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb064-18b8-44d3-8d80-7d4171eef14b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:52.392311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb064-18b8-44d3-8d80-7d4171eef14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:52.392653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb064-18b8-44d3-8d80-7d4171eef14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.393574 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fb064-18b8-44d3-8d80-7d4171eef14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:52.395297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fb064-18b8-44d3-8d80-7d4171eef14b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:52.409277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1396/2777] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:52.410543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:52.420674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23e86d-c676-43df-a3dd-46712e9b836d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:52.426271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:52.427022 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:52.427436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:52.427647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] PATH_INFO: `/v3/projects/e8f3d79881504b3b93e4a37d69a6aa33/users/deb39d9663f3440fbc4c5efee139a5ce/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.444734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f3d79881504b3b93e4a37d69a6aa33, user_id=deb39d9663f3440fbc4c5efee139a5ce, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:52.447451 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:52.516165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1382/2778] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:52 2022] PUT /identity/v3/projects/e8f3d79881504b3b93e4a37d69a6aa33/users/deb39d9663f3440fbc4c5efee139a5ce/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:52.593209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf778-59ba-4156-b79d-bea47db14de5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:52.593209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf778-59ba-4156-b79d-bea47db14de5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:52.593209 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebf778-59ba-4156-b79d-bea47db14de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.616265 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c1ebf778-59ba-4156-b79d-bea47db14de5 None None] MFA Rules not processed for user `deb39d9663f3440fbc4c5efee139a5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:52.617467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c1ebf778-59ba-4156-b79d-bea47db14de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:52.622501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:52.697113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1397/2779] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:52.709007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:52.710931 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:52.778168 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852e94f-c381-47d6-bf5f-157dd7c370aa admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:52.783279 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9685c8b244249b2d29f4612a3e5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:52.792628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:52.792628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:52.792628 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:52.793991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:52.795594 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:52.805606 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1383/2780] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:53.578138 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb832a6-f4c6-429b-8212-ab07f1e19c90 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:53.578672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb832a6-f4c6-429b-8212-ab07f1e19c90 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:53.578897 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb832a6-f4c6-429b-8212-ab07f1e19c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:53.608568 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1cb832a6-f4c6-429b-8212-ab07f1e19c90 None None] MFA Rules not processed for user `613429b45d9841d58f44381156033964`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:53.609919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1cb832a6-f4c6-429b-8212-ab07f1e19c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:53.682683 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1398/2781] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:53.686988 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:53.754837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:53.772862 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976bcc-09ef-4520-9c8b-f943c1da5123 service glance] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:53.777565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:53.778210 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:53.778494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:53.778771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:53.779496 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:53.781462 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:53.902733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1384/2782] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:53 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:53.903784 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb832a6-f4c6-429b-8212-ab07f1e19c90 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:53.914665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb832a6-f4c6-429b-8212-ab07f1e19c90 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:53.972701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:53.973309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:53.973587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:53.973900 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:53.974537 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:53.976717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:54.092288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1399/2783] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:53 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:54.096709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:54.107460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1d395-ddf3-4404-8bf2-f64047508ff7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:54.112574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:54.113238 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:54.113520 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:54.113889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:54.114532 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:54.116098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:54.126664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1385/2784] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:54.132323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:54.142035 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b412f-2f4f-4cba-9f8c-08e491bdfe24 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:54.147916 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:54.148558 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:54.148865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:54.149136 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] PATH_INFO: `/v3/projects/87b56d40fe114304b8797e9f27b1fed4/users/d5dc64531e5744b6bd6dd34b9fc63c6e/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:54.164346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b56d40fe114304b8797e9f27b1fed4, user_id=d5dc64531e5744b6bd6dd34b9fc63c6e, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:54.167723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:54.240509 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1400/2785] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:54 2022] PUT /identity/v3/projects/87b56d40fe114304b8797e9f27b1fed4/users/d5dc64531e5744b6bd6dd34b9fc63c6e/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:54.244379 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:54.254626 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643438af-dab7-42b8-baec-8abadbf39dcc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:54.317821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:54.318476 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:54.318758 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:54.319042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:54.319702 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:54.321370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:54.333453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1386/2786] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:54.338196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:54.344473 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:54.351732 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38ca66-27cc-4e0b-8d7e-2e4b5ff3a06a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:54.357388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba430c8b-7166-454f-9ec0-742539eb8aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:54.358082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430c8b-7166-454f-9ec0-742539eb8aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:54.358364 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430c8b-7166-454f-9ec0-742539eb8aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:54.358640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba430c8b-7166-454f-9ec0-742539eb8aaf admin admin] PATH_INFO: `/v3/projects/87b56d40fe114304b8797e9f27b1fed4/users/d5dc64531e5744b6bd6dd34b9fc63c6e/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:54.360569 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba430c8b-7166-454f-9ec0-742539eb8aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b56d40fe114304b8797e9f27b1fed4, user_id=d5dc64531e5744b6bd6dd34b9fc63c6e, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:54.363539 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba430c8b-7166-454f-9ec0-742539eb8aaf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:54.374962 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1401/2787] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:54 2022] PUT /identity/v3/projects/87b56d40fe114304b8797e9f27b1fed4/users/d5dc64531e5744b6bd6dd34b9fc63c6e/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:54.592002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:54.593845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:54.607757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c690c5-ee64-48da-9d99-211a3dc9cc6a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:54.669271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:54.669981 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:54.670266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:54.670542 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] PATH_INFO: `/v3/users/1ccbfead682a496f83f4f5ef633a4032` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:54.671712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ccbfead682a496f83f4f5ef633a4032)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:54.673647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:54.923035 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ccbfead682a496f83f4f5ef633a4032'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:54.923734 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ccbfead682a496f83f4f5ef633a4032'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:54.978032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ccbfead682a496f83f4f5ef633a4032'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:54.980088 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:54.992839 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ccbfead682a496f83f4f5ef633a4032'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:55.009705 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ccbfead682a496f83f4f5ef633a4032'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:55.019854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1387/2788] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:54 2022] DELETE /identity/v3/users/1ccbfead682a496f83f4f5ef633a4032 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:55.024371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:55.024825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:55.024919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:55.045231 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:55.046490 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:55.115010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1402/2789] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:55.126525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:55.128806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:55.200775 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab56e3-ec11-42b3-9cce-9a7a72d7cb35 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:55.204280 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6f028-6d7d-4fb6-ab54-045dd8fae3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:55.204895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f028-6d7d-4fb6-ab54-045dd8fae3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:55.205174 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f028-6d7d-4fb6-ab54-045dd8fae3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:55.205661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f028-6d7d-4fb6-ab54-045dd8fae3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:55.215737 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6f028-6d7d-4fb6-ab54-045dd8fae3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:55.217308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6f028-6d7d-4fb6-ab54-045dd8fae3c5 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:55.230625 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1388/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:55.725412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:55.738027 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:55.759632 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53d3e0-6630-4fb5-89de-0612a748d7f7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:55.759907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53d3e0-6630-4fb5-89de-0612a748d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:55.760191 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53d3e0-6630-4fb5-89de-0612a748d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:55.775341 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea47079-d47d-4c35-9dae-ad6372d464f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:55.782687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:55.783360 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:55.783651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:55.783931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] PATH_INFO: `/v3/projects/a0c7477caff24d479df491e06da819c9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:55.785405 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c7477caff24d479df491e06da819c9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:55.787413 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:55.799577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ea53d3e0-6630-4fb5-89de-0612a748d7f7 None None] MFA Rules not processed for user `d5dc64531e5744b6bd6dd34b9fc63c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:55.803565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea53d3e0-6630-4fb5-89de-0612a748d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:55.902207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1389/2791] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:55.913298 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:55.913591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:55.915860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:55.932796 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] MFA Rules not processed for user `613429b45d9841d58f44381156033964`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:55.934043 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:55.951966 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c7477caff24d479df491e06da819c9', 'request_id': 'req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:55.962906 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c7477caff24d479df491e06da819c9', 'request_id': 'req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:55.971663 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c7477caff24d479df491e06da819c9', 'request_id': 'req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:55.994565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1390/2792] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:56.008522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:56.009909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:56.056717 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] The token cache is being invalidate because project a0c7477caff24d479df491e06da819c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:56.057303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:56.057973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:56.059621 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1403/2793] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:55 2022] DELETE /identity/v3/projects/a0c7477caff24d479df491e06da819c9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:56.067980 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:56.069442 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:56.091272 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae7c07-4a47-4d3e-8e17-7e1b969a1da3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:56.126242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:56.145152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2c618-7189-4f2d-b2e2-2794fdc8ed5f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:56.150038 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:56.150687 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:56.150968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:56.151246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] PATH_INFO: `/v3/users/09b7a2315649435eb93fc89d0dbe25c0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:56.152383 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b7a2315649435eb93fc89d0dbe25c0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:56.154362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:56.164374 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:56.164987 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:56.165271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:56.165546 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:56.167447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:56.174865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:56.230773 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:56.232364 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:56.241367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1391/2794] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:16:56.367766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b7a2315649435eb93fc89d0dbe25c0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:56.445863 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b7a2315649435eb93fc89d0dbe25c0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:56.453939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b7a2315649435eb93fc89d0dbe25c0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:56.454696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b7a2315649435eb93fc89d0dbe25c0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:56.470766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b7a2315649435eb93fc89d0dbe25c0'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:56.477746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1404/2795] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:56 2022] DELETE /identity/v3/users/09b7a2315649435eb93fc89d0dbe25c0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:56.484275 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:56.492431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:56.552860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c067f-f7ac-4835-b4cd-8f503304b231 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:56.604921 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6cfee-a2b1-4bbb-bb25-175fefb15c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:56.605533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6cfee-a2b1-4bbb-bb25-175fefb15c9e service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:56.605836 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6cfee-a2b1-4bbb-bb25-175fefb15c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:56.606134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6cfee-a2b1-4bbb-bb25-175fefb15c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:56.607869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-22d6cfee-a2b1-4bbb-bb25-175fefb15c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:56.617837 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6cfee-a2b1-4bbb-bb25-175fefb15c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:56.619631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6cfee-a2b1-4bbb-bb25-175fefb15c9e service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:56.629051 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1392/2796] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:56.641076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:57.008185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:57.009750 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:57.085257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481d4a-93b7-482e-9873-577f2abf546e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:57.090675 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:57.096513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.096513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.096513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] PATH_INFO: `/v3/projects/3ef73bc0829e41e4bf8e7ca7bef570f1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.096513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef73bc0829e41e4bf8e7ca7bef570f1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:57.097599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:57.243228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef73bc0829e41e4bf8e7ca7bef570f1', 'request_id': 'req-b24a96f1-d78f-4ee7-89cf-861477ff9152'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:57.249271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef73bc0829e41e4bf8e7ca7bef570f1', 'request_id': 'req-b24a96f1-d78f-4ee7-89cf-861477ff9152'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:57.259116 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef73bc0829e41e4bf8e7ca7bef570f1', 'request_id': 'req-b24a96f1-d78f-4ee7-89cf-861477ff9152'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:57.343340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] The token cache is being invalidate because project 3ef73bc0829e41e4bf8e7ca7bef570f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:16:57.343566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:57.344255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b24a96f1-d78f-4ee7-89cf-861477ff9152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:57.345661 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1405/2797] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:16:57 2022] DELETE /identity/v3/projects/3ef73bc0829e41e4bf8e7ca7bef570f1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:57.351553 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be204-60d7-4dfe-8238-2c652563685e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.352032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be204-60d7-4dfe-8238-2c652563685e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.352141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be204-60d7-4dfe-8238-2c652563685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.373521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-728be204-60d7-4dfe-8238-2c652563685e None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:57.376377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-728be204-60d7-4dfe-8238-2c652563685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:57.439018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1393/2798] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:16:57.448461 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd93d-c3f2-4607-a8db-5cb25a61b788 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.448768 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd93d-c3f2-4607-a8db-5cb25a61b788 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.449016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd93d-c3f2-4607-a8db-5cb25a61b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.468645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d3dfd93d-c3f2-4607-a8db-5cb25a61b788 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:57.469933 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d3dfd93d-c3f2-4607-a8db-5cb25a61b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:57.479424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1406/2799] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:57.483792 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be204-60d7-4dfe-8238-2c652563685e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:57.495130 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728be204-60d7-4dfe-8238-2c652563685e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:57.499785 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:57.500461 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.500670 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.500943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.501627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:16:57.502139 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:57.504332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:57.516895 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1394/2800] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:16:57.521629 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd93d-c3f2-4607-a8db-5cb25a61b788 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:57.531223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd93d-c3f2-4607-a8db-5cb25a61b788 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:57.537053 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:57.537659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.537973 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.538248 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.538922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:57.540883 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:57.558339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:57.667630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1407/2801] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:57 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:57.672024 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:57.683517 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e270d2c-3526-40ee-bb1f-4972c1bf0919 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:57.756925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:57.757563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.757872 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.758230 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.759250 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:57.761858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:57.843008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1395/2802] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:57 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:57.845206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:57.859493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ebece-e758-475e-923f-899a8d7c2ba7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:57.862695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:57.863298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.863580 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.863854 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.864617 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:57.866401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:57.880204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1408/2803] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:57.883979 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:57.895504 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c277e5-5a88-4e2f-adf1-93123291f55e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:57.900320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd1d67-013c-4e7e-b5a6-1819beef91b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:57.900937 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1d67-013c-4e7e-b5a6-1819beef91b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.901218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1d67-013c-4e7e-b5a6-1819beef91b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.901494 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd1d67-013c-4e7e-b5a6-1819beef91b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.902176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd1d67-013c-4e7e-b5a6-1819beef91b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:57.903772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd1d67-013c-4e7e-b5a6-1819beef91b0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:57.915604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1396/2804] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:57.920374 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:57.931706 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11cd5-1479-4f7d-809e-9bd49bc974b2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:57.936491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:57.937145 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:57.937424 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:57.937702 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] PATH_INFO: `/v3/projects/d47c90ce917c48cc908c0308522cd2a3/users/fdddaab9dfe34394b6753149e2cf9da6/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:57.956134 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47c90ce917c48cc908c0308522cd2a3, user_id=fdddaab9dfe34394b6753149e2cf9da6, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:57.958893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:58.057792 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1409/2805] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:57 2022] PUT /identity/v3/projects/d47c90ce917c48cc908c0308522cd2a3/users/fdddaab9dfe34394b6753149e2cf9da6/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:58.070552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334ca2a-ed4a-42e0-8587-7492087717cf None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.070858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334ca2a-ed4a-42e0-8587-7492087717cf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.071158 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334ca2a-ed4a-42e0-8587-7492087717cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.079574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:58.104345 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8334ca2a-ed4a-42e0-8587-7492087717cf None None] MFA Rules not processed for user `fdddaab9dfe34394b6753149e2cf9da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:58.105635 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8334ca2a-ed4a-42e0-8587-7492087717cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:58.181700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1397/2806] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:58.187242 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:58.263934 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7e348-7705-47cf-874e-ab63084df088 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:58.269665 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:58.270340 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.270628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.270907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.271545 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:58.273602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:58.352488 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1410/2807] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:16:58 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:16:58.355277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334ca2a-ed4a-42e0-8587-7492087717cf None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:58.368728 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334ca2a-ed4a-42e0-8587-7492087717cf None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:58.433853 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:58.434471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.434751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.435021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.435650 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:58.437588 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:58.532003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1398/2808] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:16:58 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:16:58.536327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:58.547431 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce28ba-f2b6-4ac9-bdbe-e8fcb7459f9f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:58.552936 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:58.553555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.553872 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.554152 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.554827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:58.556658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:58.568884 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1411/2809] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:58.573751 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:58.585308 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68e0b8-295e-42d2-851e-8642334f6be1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:58.590271 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:58.591000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.591286 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.591558 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] PATH_INFO: `/v3/projects/4e9e391108e941a694bd33e67ee3b7da/users/5dbd30aeb5624801abeebf33983c0620/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.607477 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9e391108e941a694bd33e67ee3b7da, user_id=5dbd30aeb5624801abeebf33983c0620, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:58.610154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:58.663460 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1399/2810] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:58 2022] PUT /identity/v3/projects/4e9e391108e941a694bd33e67ee3b7da/users/5dbd30aeb5624801abeebf33983c0620/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:16:58.667412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:58.678611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ff92a-583c-42fe-a4be-4f34a361a6ba admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:58.741328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b604-6160-4820-bfd5-796669f053d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:58.741982 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b604-6160-4820-bfd5-796669f053d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.742265 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b604-6160-4820-bfd5-796669f053d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.742544 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b604-6160-4820-bfd5-796669f053d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.743192 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b604-6160-4820-bfd5-796669f053d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:58.744829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b604-6160-4820-bfd5-796669f053d7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:58.755978 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1412/2811] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:16:58.760566 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:58.771631 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c88a4-a86c-4a08-81dd-3022df4d3dd5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:58.776215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:58.776869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.777149 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.777420 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] PATH_INFO: `/v3/projects/4e9e391108e941a694bd33e67ee3b7da/users/5dbd30aeb5624801abeebf33983c0620/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.779343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9e391108e941a694bd33e67ee3b7da, user_id=5dbd30aeb5624801abeebf33983c0620, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:58.782014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:58.792967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1400/2812] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:16:58 2022] PUT /identity/v3/projects/4e9e391108e941a694bd33e67ee3b7da/users/5dbd30aeb5624801abeebf33983c0620/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:58.803992 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15d4c-30f2-4073-98f7-35a8323947e2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.804282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15d4c-30f2-4073-98f7-35a8323947e2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:58.807555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b15d4c-30f2-4073-98f7-35a8323947e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:58.835826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a6b15d4c-30f2-4073-98f7-35a8323947e2 None None] MFA Rules not processed for user `5dbd30aeb5624801abeebf33983c0620`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:58.837032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a6b15d4c-30f2-4073-98f7-35a8323947e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:58.856190 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:58.912747 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1413/2813] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:58.924599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:58.926325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:58.989135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:58.995277 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb2e3d-8a77-4b87-abe2-607f38c13c4f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:58.999096 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0146d-30b0-4ee4-b515-822d698e2830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:58.999700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0146d-30b0-4ee4-b515-822d698e2830 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:58.999976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0146d-30b0-4ee4-b515-822d698e2830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:59.000245 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0146d-30b0-4ee4-b515-822d698e2830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:59.011086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0146d-30b0-4ee4-b515-822d698e2830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:59.012940 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0146d-30b0-4ee4-b515-822d698e2830 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:59.024478 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1401/2814] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:16:59.103709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15d4c-30f2-4073-98f7-35a8323947e2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:59.172267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b15d4c-30f2-4073-98f7-35a8323947e2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:59.182040 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:59.182666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:59.182943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:59.183215 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] PATH_INFO: `/v3/users/fdddaab9dfe34394b6753149e2cf9da6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:59.184370 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdddaab9dfe34394b6753149e2cf9da6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:59.186380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:59.363585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdddaab9dfe34394b6753149e2cf9da6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:59.481240 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdddaab9dfe34394b6753149e2cf9da6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:59.490893 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdddaab9dfe34394b6753149e2cf9da6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:59.491612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdddaab9dfe34394b6753149e2cf9da6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:59.511532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdddaab9dfe34394b6753149e2cf9da6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:16:59.519382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1414/2815] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:16:59 2022] DELETE /identity/v3/users/fdddaab9dfe34394b6753149e2cf9da6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:16:59.524371 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:59.524913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:59.525014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:59.547540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:16:59.549436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:59.621090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1402/2816] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:16:59.631605 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:16:59.633489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:16:59.672069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:16:59.698677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd350d5-cd24-407e-83cf-1295bc392e0e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:16:59.702414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:16:59.703071 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:16:59.703339 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:16:59.703616 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:16:59.713158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:16:59.714630 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:16:59.730182 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1415/2817] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:00.179315 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:00.180750 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:00.193636 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a07c9a-d725-4ad1-9a0c-090398628d01 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:00.204653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:00.204653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:00.204653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:00.204653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] PATH_INFO: `/v3/projects/d47c90ce917c48cc908c0308522cd2a3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:00.205621 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47c90ce917c48cc908c0308522cd2a3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:00.207603 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:00.316424 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47c90ce917c48cc908c0308522cd2a3', 'request_id': 'req-ae3380da-693c-4178-a8e7-416d984974c0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.322710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47c90ce917c48cc908c0308522cd2a3', 'request_id': 'req-ae3380da-693c-4178-a8e7-416d984974c0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.329132 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47c90ce917c48cc908c0308522cd2a3', 'request_id': 'req-ae3380da-693c-4178-a8e7-416d984974c0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.370953 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] The token cache is being invalidate because project d47c90ce917c48cc908c0308522cd2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:00.371240 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.371885 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.373500 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1403/2818] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:00 2022] DELETE /identity/v3/projects/d47c90ce917c48cc908c0308522cd2a3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:00.378495 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:00.389234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fb5f2-9d56-4dd2-8a4f-7f1c3561cff1 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:00.458052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:00.459046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:00.459046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:00.459258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] PATH_INFO: `/v3/users/5dbd30aeb5624801abeebf33983c0620` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:00.460441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbd30aeb5624801abeebf33983c0620)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:00.462403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:00.625225 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbd30aeb5624801abeebf33983c0620'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.686323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbd30aeb5624801abeebf33983c0620'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.694800 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbd30aeb5624801abeebf33983c0620'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.695620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbd30aeb5624801abeebf33983c0620'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.713651 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e6a7924c-9bba-40a6-b403-fbed89805ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbd30aeb5624801abeebf33983c0620'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:00.720054 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1416/2819] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:00 2022] DELETE /identity/v3/users/5dbd30aeb5624801abeebf33983c0620 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:01.349402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:01.349402 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:01.365144 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3380da-693c-4178-a8e7-416d984974c0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:01.446453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:01.447090 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:01.447426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:01.447661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] PATH_INFO: `/v3/projects/4e9e391108e941a694bd33e67ee3b7da` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:01.448924 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9e391108e941a694bd33e67ee3b7da)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:01.452134 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:01.468925 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:01.561709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9e391108e941a694bd33e67ee3b7da', 'request_id': 'req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:01.569891 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9e391108e941a694bd33e67ee3b7da', 'request_id': 'req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:01.575574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9e391108e941a694bd33e67ee3b7da', 'request_id': 'req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:01.646430 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] The token cache is being invalidate because project 4e9e391108e941a694bd33e67ee3b7da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:01.646727 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:01.647368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7fb7b600-5810-44c8-a530-ab0ed2fd01d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:01.649122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1404/2820] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:01 2022] DELETE /identity/v3/projects/4e9e391108e941a694bd33e67ee3b7da => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:01.653812 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ef9c-ca81-46eb-bdf4-89eb2467ddcf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:01.654373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ef9c-ca81-46eb-bdf4-89eb2467ddcf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:01.654602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ef9c-ca81-46eb-bdf4-89eb2467ddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:01.679285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a342ef9c-ca81-46eb-bdf4-89eb2467ddcf None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:01.680485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a342ef9c-ca81-46eb-bdf4-89eb2467ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:01.754755 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:01.765501 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1417/2821] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:01.778725 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354bf40-51dd-420d-bf09-b97cf2be859a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:01.779014 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354bf40-51dd-420d-bf09-b97cf2be859a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:01.779297 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354bf40-51dd-420d-bf09-b97cf2be859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:01.803525 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b354bf40-51dd-420d-bf09-b97cf2be859a None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:01.804220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b354bf40-51dd-420d-bf09-b97cf2be859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:01.812570 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1405/2822] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:01.818051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ef9c-ca81-46eb-bdf4-89eb2467ddcf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:01.827595 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ef9c-ca81-46eb-bdf4-89eb2467ddcf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:01.836163 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:01.836785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:01.837064 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:01.837333 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:01.838066 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:17:01.838371 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:01.845425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:01.859960 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1418/2823] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:17:01.864161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354bf40-51dd-420d-bf09-b97cf2be859a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:01.873452 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354bf40-51dd-420d-bf09-b97cf2be859a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:01.878307 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:01.878906 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:01.879183 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:01.879455 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:01.880089 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:01.882000 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:01.984848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1406/2824] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:17:01.989467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:01.999427 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5115ca-0fc9-4806-975b-feec3ce8c99d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:02.059097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:02.059816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:02.060174 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:02.060520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:02.061323 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:02.063699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:02.178888 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1419/2825] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:17:01 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:17:02.183400 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:02.194714 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3da26-49f3-43a9-83d1-6447777de710 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:02.199281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:02.199887 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:02.200165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:02.200483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:02.201126 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:02.202732 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:02.216582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1407/2826] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:17:02.220608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:02.231104 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2daf4-9e17-472a-992c-e098b6bbcb10 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:02.236745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b490f-6506-4c8c-9d8d-d2105382e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:02.237384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b490f-6506-4c8c-9d8d-d2105382e855 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:02.237669 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b490f-6506-4c8c-9d8d-d2105382e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:02.237979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b490f-6506-4c8c-9d8d-d2105382e855 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:02.241310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b490f-6506-4c8c-9d8d-d2105382e855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:02.241310 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b490f-6506-4c8c-9d8d-d2105382e855 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:02.251590 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1420/2827] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:17:02.256278 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:02.266527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d8a1c-4617-42f0-ba4b-a58e97e4fe89 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:02.272717 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:02.273389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:02.273674 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:02.273989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] PATH_INFO: `/v3/projects/595ebaa70d284adeb587c72b158b18ab/users/0848dce7a5a64fc7b7996b446356c645/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:02.289258 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] RBAC: Authorizing `identity:create_grant(project_id=595ebaa70d284adeb587c72b158b18ab, user_id=0848dce7a5a64fc7b7996b446356c645, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:02.291951 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:02.360863 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1408/2828] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:17:02 2022] PUT /identity/v3/projects/595ebaa70d284adeb587c72b158b18ab/users/0848dce7a5a64fc7b7996b446356c645/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:02.372141 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9921c-4322-4ea0-83d9-3af84cf05e71 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:02.372433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9921c-4322-4ea0-83d9-3af84cf05e71 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:02.372714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9921c-4322-4ea0-83d9-3af84cf05e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:02.403373 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f5e9921c-4322-4ea0-83d9-3af84cf05e71 None None] MFA Rules not processed for user `0848dce7a5a64fc7b7996b446356c645`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:02.404588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f5e9921c-4322-4ea0-83d9-3af84cf05e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:02.476292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1421/2829] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:02.487678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:02.489342 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:02.548301 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac4942-69c7-4ecc-b3a7-16a7319f948b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:02.552377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:02.552968 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:02.553253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:02.553530 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:02.561913 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:02.563351 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:02.572399 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1409/2830] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:11.154455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9921c-4322-4ea0-83d9-3af84cf05e71 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:11.164769 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9921c-4322-4ea0-83d9-3af84cf05e71 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:11.168414 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe1550-b1b9-45d7-b992-97382f8da19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:11.169010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1550-b1b9-45d7-b992-97382f8da19b service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:11.169292 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1550-b1b9-45d7-b992-97382f8da19b service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:11.169682 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe1550-b1b9-45d7-b992-97382f8da19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:11.174850 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-28fe1550-b1b9-45d7-b992-97382f8da19b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:11.220191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:11.236896 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe1550-b1b9-45d7-b992-97382f8da19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:11.238890 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe1550-b1b9-45d7-b992-97382f8da19b service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:11.249095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1422/2831] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:12.568378 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:16.410246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:16.411660 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:16.490068 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b3d8-ae76-417d-aef3-2c4a5325ec06 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:16.499644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:16.499644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:16.499644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:16.499644 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] PATH_INFO: `/v3/users/deb39d9663f3440fbc4c5efee139a5ce` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:16.500064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb39d9663f3440fbc4c5efee139a5ce)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:16.500064 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:16.739073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb39d9663f3440fbc4c5efee139a5ce'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:16.739772 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb39d9663f3440fbc4c5efee139a5ce'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:16.827967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb39d9663f3440fbc4c5efee139a5ce'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:16.835368 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb39d9663f3440fbc4c5efee139a5ce'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:16.848614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb39d9663f3440fbc4c5efee139a5ce'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:16.855318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1410/2832] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:16 2022] DELETE /identity/v3/users/deb39d9663f3440fbc4c5efee139a5ce => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:16.859924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:16.860407 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:16.860507 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:16.880345 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:16.881519 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:16.942086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1423/2833] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:16.952521 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:16.954011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:17.011901 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761e0e-1c88-4a15-8dd3-2c1376902c92 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:17.015723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:17.016274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.016552 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.016823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:17.026527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:17.028003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:17.037220 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1411/2834] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:17.470330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:17.472047 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:17.487553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e8cb-7c6e-48be-bf6e-5558c546ea61 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:17.492834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:17.493677 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.493909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.494191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] PATH_INFO: `/v3/projects/e8f3d79881504b3b93e4a37d69a6aa33` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:17.496009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f3d79881504b3b93e4a37d69a6aa33)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:17.498034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:17.600135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:17.601902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:17.615676 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25db81-b9a7-4ac2-b5b0-9977d3efcc89 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:17.617132 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f3d79881504b3b93e4a37d69a6aa33', 'request_id': 'req-8064f25b-cde5-4bbd-be85-a92a993f0569'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.626042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f3d79881504b3b93e4a37d69a6aa33', 'request_id': 'req-8064f25b-cde5-4bbd-be85-a92a993f0569'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.633177 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f3d79881504b3b93e4a37d69a6aa33', 'request_id': 'req-8064f25b-cde5-4bbd-be85-a92a993f0569'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.637855 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:17.679852 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:17.680486 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.680759 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.681046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] PATH_INFO: `/v3/users/0848dce7a5a64fc7b7996b446356c645` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:17.682411 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0848dce7a5a64fc7b7996b446356c645)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:17.684387 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:17.692273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] The token cache is being invalidate because project e8f3d79881504b3b93e4a37d69a6aa33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:17.692579 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.693224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8064f25b-cde5-4bbd-be85-a92a993f0569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.694846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1424/2835] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:17 2022] DELETE /identity/v3/projects/e8f3d79881504b3b93e4a37d69a6aa33 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:17.702246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbafc24-eff0-4fee-92b5-539b6a1aa421 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.702246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbafc24-eff0-4fee-92b5-539b6a1aa421 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.702246 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbafc24-eff0-4fee-92b5-539b6a1aa421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:17.736492 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8fbafc24-eff0-4fee-92b5-539b6a1aa421 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:17.737789 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8fbafc24-eff0-4fee-92b5-539b6a1aa421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:17.747885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1425/2836] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:17:17.755860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c44f3-a9d9-4ff7-a0df-fbac9a5003b4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.756208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c44f3-a9d9-4ff7-a0df-fbac9a5003b4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.756552 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c44f3-a9d9-4ff7-a0df-fbac9a5003b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:17.778865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0e2c44f3-a9d9-4ff7-a0df-fbac9a5003b4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:17.780113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0e2c44f3-a9d9-4ff7-a0df-fbac9a5003b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:17.789120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1426/2837] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:17:17.794183 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c44f3-a9d9-4ff7-a0df-fbac9a5003b4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:17.803312 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c44f3-a9d9-4ff7-a0df-fbac9a5003b4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:17.808446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:17.809042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.809423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.809623 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:17.810330 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:17:17.810613 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:17.812282 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:17.825586 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1427/2838] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:17:17.830033 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:17.840409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea451a9-0999-49c7-9ccd-ffe60bee03d6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:17.845051 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:17.845643 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.847162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.847162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:17.847162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:17.848821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:17.871435 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0848dce7a5a64fc7b7996b446356c645'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.872098 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0848dce7a5a64fc7b7996b446356c645'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.942299 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0848dce7a5a64fc7b7996b446356c645'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.952032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0848dce7a5a64fc7b7996b446356c645'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.952592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1428/2839] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:17:17 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:17:17.958728 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:17.974004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-dba21805-577b-4ea8-9695-0205c2852e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0848dce7a5a64fc7b7996b446356c645'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:17.982003 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1412/2840] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:17 2022] DELETE /identity/v3/users/0848dce7a5a64fc7b7996b446356c645 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:17:17.989973 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:17.990094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:17.990207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:17.990207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.006848 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:18.008967 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:18.031515 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ccb9b-6418-4751-b2ba-684152720c1e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.077102 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1413/2841] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:18.089721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:18.089721 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:18.094110 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.094764 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.095275 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.095571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.096198 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.098411 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.147508 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:18.159599 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce4d4f-fbf3-453f-997c-5544ccf94426 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.163330 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.163942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.164221 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.164534 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.173675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.175143 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.184278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1429/2842] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:17:17 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:17:18.186208 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1414/2843] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 16:17:18.188350 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:18.190032 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:18.202882 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51176e6a-c854-4c4c-8f4b-7aa66dab502a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.207657 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.208267 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.208548 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.208826 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.209472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.211113 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.221554 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1430/2844] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:17:18.226319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:18.237602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43316ca1-9c87-4616-9d54-f05af7b33711 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.243178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14670524-5ab1-4138-a966-1b95fd4698ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.243920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670524-5ab1-4138-a966-1b95fd4698ce admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.244209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670524-5ab1-4138-a966-1b95fd4698ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.244483 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14670524-5ab1-4138-a966-1b95fd4698ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.245120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14670524-5ab1-4138-a966-1b95fd4698ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.246738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14670524-5ab1-4138-a966-1b95fd4698ce admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.257294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1415/2845] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:17:18.264181 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:18.273448 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a1ab7-1a4b-46a1-b448-fd3bec6395d3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.279856 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.280553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.292628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.292628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] PATH_INFO: `/v3/projects/cf802ff85a44487f9aac170cee790689/users/ce484ab9fad24de39f288c03eed8310a/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.297389 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf802ff85a44487f9aac170cee790689, user_id=ce484ab9fad24de39f288c03eed8310a, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.300250 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.402094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1431/2846] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:17:18 2022] PUT /identity/v3/projects/cf802ff85a44487f9aac170cee790689/users/ce484ab9fad24de39f288c03eed8310a/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:18.413604 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.413934 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.414217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.442788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] MFA Rules not processed for user `ce484ab9fad24de39f288c03eed8310a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:18.444008 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:18.515302 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1416/2847] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:18.527788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:18.529591 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:18.587142 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a100ef-1c6f-416d-ba1f-974ca2e43ae5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.591238 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.591835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.592115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.592428 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.601203 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.602881 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.611751 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1432/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:18.623571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:18.623571 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:18.641504 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:18.671072 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:18.698243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72d8b6-d63b-4b66-9617-831c4d1b3fd7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.702821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.703456 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.703749 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.704011 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] PATH_INFO: `/v3/projects/595ebaa70d284adeb587c72b158b18ab` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.705150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=595ebaa70d284adeb587c72b158b18ab)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.707080 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.714695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499562c-7908-41e2-b4a9-42e33ce02f1b service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:18.714695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:18.714695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.715166 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.715277 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] PATH_INFO: `/v3/users/ce484ab9fad24de39f288c03eed8310a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.716886 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce484ab9fad24de39f288c03eed8310a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:18.719013 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:18.794249 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595ebaa70d284adeb587c72b158b18ab', 'request_id': 'req-08ee3beb-a13b-4372-8283-ad75bfa746b9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.800324 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595ebaa70d284adeb587c72b158b18ab', 'request_id': 'req-08ee3beb-a13b-4372-8283-ad75bfa746b9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.806794 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595ebaa70d284adeb587c72b158b18ab', 'request_id': 'req-08ee3beb-a13b-4372-8283-ad75bfa746b9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.809256 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:18.896086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] The token cache is being invalidate because project 595ebaa70d284adeb587c72b158b18ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:18.896380 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.897165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08ee3beb-a13b-4372-8283-ad75bfa746b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.898747 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1417/2849] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:18 2022] DELETE /identity/v3/projects/595ebaa70d284adeb587c72b158b18ab => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:18.904196 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e836b-2fc0-4f66-8428-ca002d080a11 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.910377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e836b-2fc0-4f66-8428-ca002d080a11 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.910377 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e836b-2fc0-4f66-8428-ca002d080a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:18.910598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce484ab9fad24de39f288c03eed8310a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.924181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cf2e836b-2fc0-4f66-8428-ca002d080a11 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:18.925391 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cf2e836b-2fc0-4f66-8428-ca002d080a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:18.984105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce484ab9fad24de39f288c03eed8310a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.993976 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1418/2850] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:18.994467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce484ab9fad24de39f288c03eed8310a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.994680 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce484ab9fad24de39f288c03eed8310a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:18.995983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84233-9b37-4503-bc47-a7636bc98ec4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:18.998079 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84233-9b37-4503-bc47-a7636bc98ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:18.998369 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e84233-9b37-4503-bc47-a7636bc98ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.011043 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bacc23bc-9879-4681-8582-ffe46a7fbd71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce484ab9fad24de39f288c03eed8310a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:19.017518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1433/2851] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:18 2022] DELETE /identity/v3/users/ce484ab9fad24de39f288c03eed8310a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:19.022270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.022690 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.022860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-14e84233-9b37-4503-bc47-a7636bc98ec4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:19.023082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.024207 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-14e84233-9b37-4503-bc47-a7636bc98ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:19.046335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:19.047779 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:19.093471 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1419/2852] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:19.097584 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84233-9b37-4503-bc47-a7636bc98ec4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.108876 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e84233-9b37-4503-bc47-a7636bc98ec4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.114002 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.114600 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.114883 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.115159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.115845 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:17:19.116176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.118764 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.123480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1434/2853] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:19.131248 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1420/2854] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 16:17:19.135441 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.135602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.137044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:19.151616 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d23ee2-13c5-4499-8b57-8e4a50794b87 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.156567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.157178 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.157465 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.157744 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.158422 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.160325 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.191522 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:19.202718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8187ae-2585-44a0-97ef-8a286a08ddde None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.206508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.207150 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.207432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.207707 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.216611 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.218101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.229048 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1435/2855] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:19.330370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1421/2856] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:17:19 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:17:19.331532 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.341236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2eb4a-b89b-41b9-8a13-1305d67c848a service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.397107 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.397711 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.398030 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.398309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.399672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.401585 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.497317 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1436/2857] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:17:19 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:17:19.501691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.513413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75977c64-53d6-4493-9883-f63f8ccc67a5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.518294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.518930 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.519212 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.519540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.522053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.522053 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.536688 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1422/2858] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:17:19.537825 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.550829 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c5ed9-a919-4af6-abdb-c86a8e867e3f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.564867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9078b-26cd-4431-819c-7ab8d9f84da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.565596 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9078b-26cd-4431-819c-7ab8d9f84da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.566123 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9078b-26cd-4431-819c-7ab8d9f84da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.566517 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9078b-26cd-4431-819c-7ab8d9f84da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.567262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9078b-26cd-4431-819c-7ab8d9f84da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.569626 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9078b-26cd-4431-819c-7ab8d9f84da9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.584954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1437/2859] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:17:19.587586 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.598870 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7397b-8ea8-4c4a-855b-afef5d3bd45c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.605076 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.605782 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.606077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.606353 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] PATH_INFO: `/v3/projects/f29c9c5122ec4977ab65c64c4450bcef/users/509aad28fa6c464ea0889d29188a2587/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.631389 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29c9c5122ec4977ab65c64c4450bcef, user_id=509aad28fa6c464ea0889d29188a2587, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.634799 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.703602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1423/2860] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:17:19 2022] PUT /identity/v3/projects/f29c9c5122ec4977ab65c64c4450bcef/users/509aad28fa6c464ea0889d29188a2587/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:19.776653 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056455f-3003-46ed-88fb-714690958745 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.776951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056455f-3003-46ed-88fb-714690958745 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.777234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056455f-3003-46ed-88fb-714690958745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.807425 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1056455f-3003-46ed-88fb-714690958745 None None] MFA Rules not processed for user `509aad28fa6c464ea0889d29188a2587`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:19.812821 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1056455f-3003-46ed-88fb-714690958745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:19.877472 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1438/2861] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:19.889282 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.891026 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:19.923516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:19.923658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056455f-3003-46ed-88fb-714690958745 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:19.924298 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1056455f-3003-46ed-88fb-714690958745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:19.956040 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34da3-27df-488a-8cc6-32c29a25900c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:19.960181 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31f9685c8b244249b2d29f4612a3e5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:19.960788 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:19.961063 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:19.961413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:19.970167 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:19.971808 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:19.982266 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1424/2862] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:19.991696 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:19.998423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056455f-3003-46ed-88fb-714690958745 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:20.004599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:20.004599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:20.004599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:20.004599 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] PATH_INFO: `/v3/projects/cf802ff85a44487f9aac170cee790689` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:20.005455 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf802ff85a44487f9aac170cee790689)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:20.007401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:20.146636 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf802ff85a44487f9aac170cee790689', 'request_id': 'req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:20.154004 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf802ff85a44487f9aac170cee790689', 'request_id': 'req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:20.160658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf802ff85a44487f9aac170cee790689', 'request_id': 'req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:20.291939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] The token cache is being invalidate because project cf802ff85a44487f9aac170cee790689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:20.292288 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:20.293011 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:20.294785 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1439/2863] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:19 2022] DELETE /identity/v3/projects/cf802ff85a44487f9aac170cee790689 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:17:30.239122 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=15 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:30.287384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:34.519466 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:34.521101 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:34.606916 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e883a6-6a82-4077-81c5-78dd1940d843 service glance] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:34.666709 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:34.667485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:34.667765 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:34.668038 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] PATH_INFO: `/v3/users/613429b45d9841d58f44381156033964` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:34.670034 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=613429b45d9841d58f44381156033964)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:34.671936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:34.860019 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613429b45d9841d58f44381156033964'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:34.860731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613429b45d9841d58f44381156033964'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:34.913323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613429b45d9841d58f44381156033964'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:34.921363 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613429b45d9841d58f44381156033964'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:34.933481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613429b45d9841d58f44381156033964'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:34.940246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1425/2864] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:34 2022] DELETE /identity/v3/users/613429b45d9841d58f44381156033964 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:35.258095 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:35.259615 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:35.323159 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66f9d1-db2b-4c34-9c4f-ae89683f1659 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:35.383055 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:35.383796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:35.384153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:35.384521 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] PATH_INFO: `/v3/projects/dedb294f3d264cb393f3ac6d68162eac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:35.385725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dedb294f3d264cb393f3ac6d68162eac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:35.388995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:35.476965 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dedb294f3d264cb393f3ac6d68162eac', 'request_id': 'req-5372de92-2611-4547-ba31-6fc0bb46b9bf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.484052 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dedb294f3d264cb393f3ac6d68162eac', 'request_id': 'req-5372de92-2611-4547-ba31-6fc0bb46b9bf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.490915 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dedb294f3d264cb393f3ac6d68162eac', 'request_id': 'req-5372de92-2611-4547-ba31-6fc0bb46b9bf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.576864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] The token cache is being invalidate because project dedb294f3d264cb393f3ac6d68162eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:35.577158 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.577830 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.583359 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1440/2865] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:35 2022] DELETE /identity/v3/projects/dedb294f3d264cb393f3ac6d68162eac => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:35.583567 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:35.584984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:35.598493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345b434-1972-4f3e-ab15-ab886443c90d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:35.610812 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:35.658484 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:35.659161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:35.659448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:35.659729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] PATH_INFO: `/v3/users/d5dc64531e5744b6bd6dd34b9fc63c6e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:35.660889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dc64531e5744b6bd6dd34b9fc63c6e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:35.662854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:35.893840 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dc64531e5744b6bd6dd34b9fc63c6e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.894419 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dc64531e5744b6bd6dd34b9fc63c6e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.969841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dc64531e5744b6bd6dd34b9fc63c6e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.977367 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dc64531e5744b6bd6dd34b9fc63c6e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.991118 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7ddc6708-5b54-45e4-ab33-5b0cd2be52f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dc64531e5744b6bd6dd34b9fc63c6e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:35.997318 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1426/2866] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:35 2022] DELETE /identity/v3/users/d5dc64531e5744b6bd6dd34b9fc63c6e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:36.286817 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:36.288271 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:36.301523 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372de92-2611-4547-ba31-6fc0bb46b9bf admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:36.348598 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:36.362739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:36.363380 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:36.363666 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:36.363944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] PATH_INFO: `/v3/projects/87b56d40fe114304b8797e9f27b1fed4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:36.365098 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b56d40fe114304b8797e9f27b1fed4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:36.367096 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:36.462928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b56d40fe114304b8797e9f27b1fed4', 'request_id': 'req-28e89df0-e597-4588-8acd-bc49dd04a170'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:36.469848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b56d40fe114304b8797e9f27b1fed4', 'request_id': 'req-28e89df0-e597-4588-8acd-bc49dd04a170'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:36.476480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b56d40fe114304b8797e9f27b1fed4', 'request_id': 'req-28e89df0-e597-4588-8acd-bc49dd04a170'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:36.548566 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] The token cache is being invalidate because project 87b56d40fe114304b8797e9f27b1fed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:36.548788 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:36.549415 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-28e89df0-e597-4588-8acd-bc49dd04a170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:36.550951 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1441/2867] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:36 2022] DELETE /identity/v3/projects/87b56d40fe114304b8797e9f27b1fed4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:36.556768 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8e0e3-6117-42c9-b9da-a59dbe4bafbc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:36.557177 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8e0e3-6117-42c9-b9da-a59dbe4bafbc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:36.557497 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8e0e3-6117-42c9-b9da-a59dbe4bafbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:36.617121 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9fd8e0e3-6117-42c9-b9da-a59dbe4bafbc None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:36.618365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9fd8e0e3-6117-42c9-b9da-a59dbe4bafbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:36.677254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1427/2868] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:36.745452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b585584-583a-4db1-b58a-395f57a7fa0b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:36.745735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b585584-583a-4db1-b58a-395f57a7fa0b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:36.746046 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b585584-583a-4db1-b58a-395f57a7fa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:36.768604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8b585584-583a-4db1-b58a-395f57a7fa0b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:36.769922 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8b585584-583a-4db1-b58a-395f57a7fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:36.778451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1442/2869] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:36.782661 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8e0e3-6117-42c9-b9da-a59dbe4bafbc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:36.792358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8e0e3-6117-42c9-b9da-a59dbe4bafbc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:36.797030 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:36.797624 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:36.797947 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:36.798218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:36.798907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:17:36.799162 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:36.800745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:36.802246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:36.813516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1428/2870] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:17:36.819382 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b585584-583a-4db1-b58a-395f57a7fa0b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:36.827401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b585584-583a-4db1-b58a-395f57a7fa0b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:36.832179 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:36.832774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:36.833059 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:36.833334 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:36.834016 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:36.835912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:36.971678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1443/2871] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:17:36 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:17:36.976182 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:36.987522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae5186-0732-40e0-b5ed-b01f45cf6a27 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:37.044128 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:37.044711 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:37.044992 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:37.045263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:37.045917 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:37.047821 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:37.131231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1429/2872] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:17:36 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 16:17:37.135338 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:37.146745 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4982d-c258-4ed8-8ef6-519a201603ac admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:37.151597 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:37.152205 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:37.152491 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:37.152766 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:37.153452 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:37.155101 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:37.165180 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1444/2873] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:17:37.170223 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:37.180474 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84761fe6-e997-4398-8024-b5e7c0b4a65c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:37.187059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77584a3-d941-4c16-9e83-d8f410bbb0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:37.187658 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77584a3-d941-4c16-9e83-d8f410bbb0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:37.187942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77584a3-d941-4c16-9e83-d8f410bbb0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:37.188213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77584a3-d941-4c16-9e83-d8f410bbb0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:37.188851 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77584a3-d941-4c16-9e83-d8f410bbb0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:37.190539 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77584a3-d941-4c16-9e83-d8f410bbb0c6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:37.202469 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1430/2874] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:17:37.206931 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:37.216946 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624062fe-067d-4c74-b91b-54db1ad48639 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:37.221640 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:37.222297 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:37.222578 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:37.222853 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] PATH_INFO: `/v3/projects/5d527fbe37ce47ee86799d96655530f7/users/afe36d1566a348adaad1898cee3c2cad/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:37.239261 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d527fbe37ce47ee86799d96655530f7, user_id=afe36d1566a348adaad1898cee3c2cad, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:37.241925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:37.314419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1445/2875] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:17:37 2022] PUT /identity/v3/projects/5d527fbe37ce47ee86799d96655530f7/users/afe36d1566a348adaad1898cee3c2cad/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:37.319718 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0c86-923e-49cf-8e9f-157dca5b17bd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:37.320097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0c86-923e-49cf-8e9f-157dca5b17bd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:37.320376 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab0c86-923e-49cf-8e9f-157dca5b17bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:37.340928 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b5ab0c86-923e-49cf-8e9f-157dca5b17bd None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:37.342265 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b5ab0c86-923e-49cf-8e9f-157dca5b17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:37.402082 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1431/2876] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:37.412378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:37.414262 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:37.489604 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74c1e9-b71c-40a0-a332-073658f38b17 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:37.493353 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:37.493990 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:37.494278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:37.494555 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:37.504730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:37.506270 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:37.511228 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:37.516847 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1446/2877] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:38.749050 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c910b-18d0-45fc-a76b-5366416047f1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:38.751253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c910b-18d0-45fc-a76b-5366416047f1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:38.751253 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c910b-18d0-45fc-a76b-5366416047f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:38.779447 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8e6c910b-18d0-45fc-a76b-5366416047f1 None None] MFA Rules not processed for user `afe36d1566a348adaad1898cee3c2cad`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:38.780691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8e6c910b-18d0-45fc-a76b-5366416047f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:38.853706 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1432/2878] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:38.864695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:38.866254 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:38.927638 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72066b2-1702-46aa-9424-1cf5e6a8c667 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:38.931303 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:38.931924 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:38.932204 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:38.932476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:38.943500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:38.944963 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:38.955723 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1447/2879] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:40.742137 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:40.746733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:40.746733 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:40.751027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:40.763710 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] MFA Rules not processed for user `afe36d1566a348adaad1898cee3c2cad`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:40.769165 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:40.772091 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1433/2880] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:42.774378 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:42.775782 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:42.865276 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff017-0464-43cc-858d-4b0bf6cbd61e service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:42.870399 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35a2df-f296-4a34-8003-f079385b5710 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:42.874844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35a2df-f296-4a34-8003-f079385b5710 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:42.874844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35a2df-f296-4a34-8003-f079385b5710 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:42.874844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35a2df-f296-4a34-8003-f079385b5710 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:42.874844 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1c35a2df-f296-4a34-8003-f079385b5710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:42.885042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35a2df-f296-4a34-8003-f079385b5710 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:42.887206 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35a2df-f296-4a34-8003-f079385b5710 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:42.896864 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1448/2881] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:45.658678 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:45.660154 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:45.674909 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7b621-495f-4190-9007-d20da6363593 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:45.679758 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:45.680395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:45.680675 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:45.681017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] PATH_INFO: `/v3/users/509aad28fa6c464ea0889d29188a2587` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:45.682281 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509aad28fa6c464ea0889d29188a2587)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:45.684429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:45.829958 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509aad28fa6c464ea0889d29188a2587'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:45.830619 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509aad28fa6c464ea0889d29188a2587'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:45.879166 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509aad28fa6c464ea0889d29188a2587'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:45.886690 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509aad28fa6c464ea0889d29188a2587'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:45.899226 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509aad28fa6c464ea0889d29188a2587'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:45.906057 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1434/2882] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:45 2022] DELETE /identity/v3/users/509aad28fa6c464ea0889d29188a2587 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:45.910433 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:45.910935 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:45.911114 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:45.931671 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:45.932944 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:45.999942 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1449/2883] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:46.010012 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:46.012235 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:46.107668 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cdacc-4755-40ee-9cfa-462c383f15a8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:46.111453 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd334e-2874-472d-aea6-9d312aaaf75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:46.112059 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd334e-2874-472d-aea6-9d312aaaf75e service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:46.112343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd334e-2874-472d-aea6-9d312aaaf75e service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:46.112614 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd334e-2874-472d-aea6-9d312aaaf75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:46.122449 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd334e-2874-472d-aea6-9d312aaaf75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:46.127874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd334e-2874-472d-aea6-9d312aaaf75e service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:46.133381 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1435/2884] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:46.858449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:46.859909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:46.875094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc90de9-da69-43d6-98aa-08b86fcc8637 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:46.879845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:46.880483 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:46.880786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:46.881061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] PATH_INFO: `/v3/projects/f29c9c5122ec4977ab65c64c4450bcef` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:46.882325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29c9c5122ec4977ab65c64c4450bcef)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:46.884196 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:46.892772 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:46.993388 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29c9c5122ec4977ab65c64c4450bcef', 'request_id': 'req-ca654053-6cef-443b-8edd-cc96f3a96828'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:46.999549 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29c9c5122ec4977ab65c64c4450bcef', 'request_id': 'req-ca654053-6cef-443b-8edd-cc96f3a96828'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:47.005685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29c9c5122ec4977ab65c64c4450bcef', 'request_id': 'req-ca654053-6cef-443b-8edd-cc96f3a96828'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:47.079058 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] The token cache is being invalidate because project f29c9c5122ec4977ab65c64c4450bcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:17:47.079348 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:47.079988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ca654053-6cef-443b-8edd-cc96f3a96828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:47.081520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1450/2885] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:17:46 2022] DELETE /identity/v3/projects/f29c9c5122ec4977ab65c64c4450bcef => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:47.086499 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a98594-ebe6-40c3-8cfb-6ce56b127073 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.086975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a98594-ebe6-40c3-8cfb-6ce56b127073 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.087086 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a98594-ebe6-40c3-8cfb-6ce56b127073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.107468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-81a98594-ebe6-40c3-8cfb-6ce56b127073 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:47.108723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-81a98594-ebe6-40c3-8cfb-6ce56b127073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:47.156358 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:47.170683 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1436/2886] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:47.178571 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea08c-b21a-4cd0-989b-664272f3d734 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.178855 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea08c-b21a-4cd0-989b-664272f3d734 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.179126 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea08c-b21a-4cd0-989b-664272f3d734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.200444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6a9ea08c-b21a-4cd0-989b-664272f3d734 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:47.201659 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6a9ea08c-b21a-4cd0-989b-664272f3d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:47.209678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1451/2887] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:47.214141 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a98594-ebe6-40c3-8cfb-6ce56b127073 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:47.223911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a98594-ebe6-40c3-8cfb-6ce56b127073 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:47.228902 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:47.229505 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.229822 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.230145 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.230841 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:17:47.231150 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:47.232748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:47.245189 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1437/2888] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:17:47.250335 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea08c-b21a-4cd0-989b-664272f3d734 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:47.259646 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea08c-b21a-4cd0-989b-664272f3d734 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:47.265258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:47.265904 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.266185 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.266458 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.267090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:47.268985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:47.378846 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1452/2889] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:17:47 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:17:47.382218 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:47.392488 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de971f2-c4ec-4369-a4e8-24fc55a51e82 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:47.448540 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:47.449653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.449966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.450242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.450858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:47.452807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:47.542027 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1438/2890] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:17:47 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:17:47.546401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:47.556797 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc8cef-783b-4d33-80ac-8ba42df8716f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:47.561559 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:47.562188 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.562466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.562735 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.563451 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:47.565041 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:47.575941 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1453/2891] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 16:17:47.579846 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:47.591094 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbda71-ec79-414b-80c7-13158fd9c82c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:47.595729 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682d8c3-ea45-4e04-8c48-b9e059435eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:47.596317 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d8c3-ea45-4e04-8c48-b9e059435eef admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.597468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d8c3-ea45-4e04-8c48-b9e059435eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.597468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d8c3-ea45-4e04-8c48-b9e059435eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.597468 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682d8c3-ea45-4e04-8c48-b9e059435eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:47.599092 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682d8c3-ea45-4e04-8c48-b9e059435eef admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:47.610993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1439/2892] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:17:47.615217 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:47.626010 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af3d3b-b0da-490f-80fc-b4639fe6c31f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:47.630827 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:47.631538 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.631700 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.631979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] PATH_INFO: `/v3/projects/1546f1ee56b34f22adf487c43e32c36c/users/4af724d9133847e4a6a6c78b80c1d107/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.647377 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1546f1ee56b34f22adf487c43e32c36c, user_id=4af724d9133847e4a6a6c78b80c1d107, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:47.650125 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:47.724513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1454/2893] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:17:47 2022] PUT /identity/v3/projects/1546f1ee56b34f22adf487c43e32c36c/users/4af724d9133847e4a6a6c78b80c1d107/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:47.736890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a70f-e5a2-45aa-9184-25bb88ccc647 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.737206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a70f-e5a2-45aa-9184-25bb88ccc647 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.737481 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a70f-e5a2-45aa-9184-25bb88ccc647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.766738 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5d57a70f-e5a2-45aa-9184-25bb88ccc647 None None] MFA Rules not processed for user `4af724d9133847e4a6a6c78b80c1d107`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:47.767936 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5d57a70f-e5a2-45aa-9184-25bb88ccc647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:47.831890 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1440/2894] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:47.843401 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:47.845069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:47.923995 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0431b9f-a7d6-4774-9938-1d6223da3c21 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:47.927603 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8869c7baa4124705bcb3a8c835f566a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:47.928208 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:47.928493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:47.928770 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:47.937577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:47.939042 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:47.947632 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1455/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:17:57.828989 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:57.943695 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:17:58.962127 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457a35-bc13-4faa-947a-3f849b38373b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:58.962587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457a35-bc13-4faa-947a-3f849b38373b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:58.962696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457a35-bc13-4faa-947a-3f849b38373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:58.982219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-24457a35-bc13-4faa-947a-3f849b38373b None None] MFA Rules not processed for user `afe36d1566a348adaad1898cee3c2cad`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:58.983426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-24457a35-bc13-4faa-947a-3f849b38373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:59.037394 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1441/2896] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:59.382556 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:59.446774 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8df1e-2658-41f6-853f-883bf78f89fc service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:59.452542 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:59.453184 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:59.453466 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:59.453744 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] PATH_INFO: `/v3/users/4af724d9133847e4a6a6c78b80c1d107` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:59.454974 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af724d9133847e4a6a6c78b80c1d107)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:59.456907 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:17:59.691672 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af724d9133847e4a6a6c78b80c1d107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:59.782352 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af724d9133847e4a6a6c78b80c1d107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:59.793902 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af724d9133847e4a6a6c78b80c1d107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:59.795076 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af724d9133847e4a6a6c78b80c1d107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:59.812577 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af724d9133847e4a6a6c78b80c1d107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:17:59.818867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1456/2897] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:17:59 2022] DELETE /identity/v3/users/4af724d9133847e4a6a6c78b80c1d107 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:17:59.823135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:59.824060 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:59.824908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:59.844332 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:17:59.845524 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:59.908262 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1442/2898] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:17:59.918867 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:17:59.920560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:17:59.982845 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21bf2b-983d-4bbd-9c12-e44a17f191b3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:17:59.986560 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d13779-c224-4ba5-9ac7-c8c62092abd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:17:59.987162 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d13779-c224-4ba5-9ac7-c8c62092abd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:17:59.987440 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d13779-c224-4ba5-9ac7-c8c62092abd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:17:59.987704 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d13779-c224-4ba5-9ac7-c8c62092abd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:17:59.997648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d13779-c224-4ba5-9ac7-c8c62092abd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:17:59.999137 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d13779-c224-4ba5-9ac7-c8c62092abd8 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:00.009020 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1457/2899] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:18:00.424017 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:00.425591 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:00.438042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc70931-ea19-4164-b5bb-3b3903dea0c4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:00.442971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:00.444306 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:00.444587 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:00.445046 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] PATH_INFO: `/v3/projects/1546f1ee56b34f22adf487c43e32c36c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:00.446209 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1546f1ee56b34f22adf487c43e32c36c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:00.448601 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:00.542920 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1546f1ee56b34f22adf487c43e32c36c', 'request_id': 'req-494169c2-05a1-4fab-a892-82908560d17e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:00.549237 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1546f1ee56b34f22adf487c43e32c36c', 'request_id': 'req-494169c2-05a1-4fab-a892-82908560d17e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:00.555543 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1546f1ee56b34f22adf487c43e32c36c', 'request_id': 'req-494169c2-05a1-4fab-a892-82908560d17e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:00.615516 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] The token cache is being invalidate because project 1546f1ee56b34f22adf487c43e32c36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:18:00.615807 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:00.616423 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:00.617943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1443/2900] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:18:00 2022] DELETE /identity/v3/projects/1546f1ee56b34f22adf487c43e32c36c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:18:10.004508 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:10.612242 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:19.210467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe82b-c235-466d-ae2b-e63db59ad34a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:19.210979 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe82b-c235-466d-ae2b-e63db59ad34a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:19.211090 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfe82b-c235-466d-ae2b-e63db59ad34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:19.240078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a4dfe82b-c235-466d-ae2b-e63db59ad34a None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:19.241255 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a4dfe82b-c235-466d-ae2b-e63db59ad34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:19.303337 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1458/2901] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Oct 3 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:18:19.437889 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:19.439343 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:19.513274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494169c2-05a1-4fab-a892-82908560d17e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:19.519021 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:19.519640 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:19.519923 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:19.520198 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:19.528243 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:19.530175 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:19.538161 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1444/2902] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:18:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:18:29.297034 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=32 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:29.534944 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=32 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:35.941964 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:35.942426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:35.942562 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:35.962283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] MFA Rules not processed for user `a977434e408a4fac94b0757de67c97cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:35.963476 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:35.971619 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1459/2903] 10.222.0.26 () {58 vars in 967 bytes} [Mon Oct 3 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:18:35.984582 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:35.995007 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2a93d-dec5-4805-b72a-c6e8e89491fd service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:36.000418 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a21de1ac06b8422fa33aae8a1ad4bcf2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:36.001010 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:36.001293 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:36.001565 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:36.009365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:36.010980 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:36.019860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1445/2904] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Oct 3 16:18:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 16:18:38.776834 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:38.778449 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:38.847807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f90f37-0e91-4ce0-a987-1301bbe46c2b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:38.852602 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:38.853223 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:38.853500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:38.853786 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] PATH_INFO: `/v3/users/afe36d1566a348adaad1898cee3c2cad` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:38.854908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe36d1566a348adaad1898cee3c2cad)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:38.856805 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:38.984714 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe36d1566a348adaad1898cee3c2cad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.066551 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe36d1566a348adaad1898cee3c2cad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.074078 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe36d1566a348adaad1898cee3c2cad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.074739 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe36d1566a348adaad1898cee3c2cad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.086879 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a18a7d1-6ac4-4509-b2e9-534ee0a061ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe36d1566a348adaad1898cee3c2cad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.092620 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1460/2905] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:18:38 2022] DELETE /identity/v3/users/afe36d1566a348adaad1898cee3c2cad => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:18:39.302719 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:39.313657 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf229cef-be0c-4c56-9bfb-c0322d5a0ba4 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:39.370880 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:39.371509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:39.371791 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:39.372062 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] PATH_INFO: `/v3/projects/5d527fbe37ce47ee86799d96655530f7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:39.373173 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d527fbe37ce47ee86799d96655530f7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:39.375135 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:39.511362 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d527fbe37ce47ee86799d96655530f7', 'request_id': 'req-7855b9a1-3d4a-4e68-990d-21b7a611261c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.518491 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d527fbe37ce47ee86799d96655530f7', 'request_id': 'req-7855b9a1-3d4a-4e68-990d-21b7a611261c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.524058 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d527fbe37ce47ee86799d96655530f7', 'request_id': 'req-7855b9a1-3d4a-4e68-990d-21b7a611261c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.618817 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] The token cache is being invalidate because project 5d527fbe37ce47ee86799d96655530f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:18:39.619106 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.619724 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7855b9a1-3d4a-4e68-990d-21b7a611261c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:18:39.621231 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1446/2906] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:18:39 2022] DELETE /identity/v3/projects/5d527fbe37ce47ee86799d96655530f7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:18:39.626608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faeac1-6a55-4ed6-abf7-0c00a8b3326b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:39.629497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faeac1-6a55-4ed6-abf7-0c00a8b3326b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:39.629497 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faeac1-6a55-4ed6-abf7-0c00a8b3326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:39.651760 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c8faeac1-6a55-4ed6-abf7-0c00a8b3326b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:39.652985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c8faeac1-6a55-4ed6-abf7-0c00a8b3326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:39.711820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1461/2907] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:18:39.720577 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806b0ab-ae75-42a2-8da4-6222748d583b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:39.720860 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806b0ab-ae75-42a2-8da4-6222748d583b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:39.721131 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806b0ab-ae75-42a2-8da4-6222748d583b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:39.741341 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7806b0ab-ae75-42a2-8da4-6222748d583b None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:39.742564 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7806b0ab-ae75-42a2-8da4-6222748d583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:39.750515 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1447/2908] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:18:39.754678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faeac1-6a55-4ed6-abf7-0c00a8b3326b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:39.764314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faeac1-6a55-4ed6-abf7-0c00a8b3326b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:39.769606 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:39.770236 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:39.770520 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:39.770796 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:39.771436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 16:18:39.771749 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:39.773346 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:39.782722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:39.785820 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1462/2909] 10.222.0.26 () {58 vars in 1153 bytes} [Mon Oct 3 16:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 16:18:39.792647 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806b0ab-ae75-42a2-8da4-6222748d583b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:39.801943 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806b0ab-ae75-42a2-8da4-6222748d583b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:39.806493 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:39.807077 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:39.807357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:39.807677 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:39.808294 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:39.810213 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:39.896680 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1448/2910] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:18:39 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:18:39.900589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:39.911111 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8d86-45d5-4ac3-8044-aca635c41e2c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:39.979810 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:39.980419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:39.980699 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:39.980975 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:39.981612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:39.984120 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:40.089409 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1463/2911] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:18:39 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:18:40.094206 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:40.104669 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1cb9-4cc2-4ef8-b615-531a9ab012d6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:40.110200 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:40.111771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:40.111771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:40.111771 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:40.112045 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:40.113630 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:40.124467 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1449/2912] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:18:40.128418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:40.138284 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af2e25-9a52-4d11-9e53-eaed3fc87b63 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:40.143730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8a034-904b-4273-9358-a8bae5a3d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:40.144315 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a034-904b-4273-9358-a8bae5a3d2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:40.144593 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a034-904b-4273-9358-a8bae5a3d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:40.144887 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8a034-904b-4273-9358-a8bae5a3d2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:40.145518 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8a034-904b-4273-9358-a8bae5a3d2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:40.147285 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8a034-904b-4273-9358-a8bae5a3d2c9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:40.158718 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1464/2913] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:18:40.162757 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:40.173522 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937fc47-19fa-4ddc-be29-baddc931c338 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:40.178222 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:40.178874 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:40.179159 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:40.179560 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] PATH_INFO: `/v3/projects/dbbf4fc709c049038f29dfe59b3f01df/users/8d49e407b37744d384fafee7f0f9af60/roles/c2fb856e141d464e9be4bbf269169309` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:40.194105 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbf4fc709c049038f29dfe59b3f01df, user_id=8d49e407b37744d384fafee7f0f9af60, role_id=c2fb856e141d464e9be4bbf269169309)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:40.196748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:40.297731 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1450/2914] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:18:40 2022] PUT /identity/v3/projects/dbbf4fc709c049038f29dfe59b3f01df/users/8d49e407b37744d384fafee7f0f9af60/roles/c2fb856e141d464e9be4bbf269169309 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:18:40.302835 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5397d-5f98-402b-8403-ba0462ecc960 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:40.303151 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5397d-5f98-402b-8403-ba0462ecc960 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:40.303426 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5397d-5f98-402b-8403-ba0462ecc960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:40.322273 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c9a5397d-5f98-402b-8403-ba0462ecc960 None None] MFA Rules not processed for user `1309f51714bc425caa70be3d6c622b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:40.323475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c9a5397d-5f98-402b-8403-ba0462ecc960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:40.385463 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1465/2915] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:18:40.395946 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:40.397745 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:40.412910 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:40.456834 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e167df-e11a-4cfd-aea5-1af3538ccc5b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:40.460485 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:40.465858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:40.465858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:40.465858 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:40.471370 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:40.472820 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:40.482752 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1451/2916] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:18:45.682945 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc6705-8a95-46b0-8bfd-0e6ffbaca14c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:45.683480 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc6705-8a95-46b0-8bfd-0e6ffbaca14c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:45.683583 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc6705-8a95-46b0-8bfd-0e6ffbaca14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:45.715746 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4cbc6705-8a95-46b0-8bfd-0e6ffbaca14c None None] MFA Rules not processed for user `8d49e407b37744d384fafee7f0f9af60`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:45.723432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4cbc6705-8a95-46b0-8bfd-0e6ffbaca14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:45.830097 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1466/2917] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:18:45.834393 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:45.845028 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa33fe-c438-4742-934b-538432fd15e0 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:45.850234 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:45.851595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:45.852048 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:45.852473 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:45.853254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:45.855357 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:45.966612 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1452/2918] 10.222.0.26 () {60 vars in 1153 bytes} [Mon Oct 3 16:18:45 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:18:45.967171 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc6705-8a95-46b0-8bfd-0e6ffbaca14c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:45.982432 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc6705-8a95-46b0-8bfd-0e6ffbaca14c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:45.989968 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:46.051624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:46.052153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:46.052513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:46.052793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:46.053730 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:46.055908 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:46.147752 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1467/2919] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Oct 3 16:18:45 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 16:18:46.151955 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:46.162664 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d5162-bd86-4b3a-810f-1b44948352c6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:46.167336 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:46.167975 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:46.168316 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:46.168595 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:46.169244 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:46.170869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:46.182323 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1453/2920] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:18:46.186362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:46.198493 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f0b32-5421-4c11-9b95-fdfe96c75d5c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:46.206061 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:46.206987 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:46.207444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:46.207894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] PATH_INFO: `/v3/projects/8d92a5119dbf4fcf9d6e61d290cef3e8/users/84b73b7e35cd4e4ea55b3c1304adad78/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:46.224394 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d92a5119dbf4fcf9d6e61d290cef3e8, user_id=84b73b7e35cd4e4ea55b3c1304adad78, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:46.227412 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:46.306947 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1468/2921] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:18:46 2022] PUT /identity/v3/projects/8d92a5119dbf4fcf9d6e61d290cef3e8/users/84b73b7e35cd4e4ea55b3c1304adad78/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:18:46.310914 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:46.321715 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8018cf-f362-475d-8348-fb0152e4d76e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:46.394073 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f4566-e2cf-4a4c-afe2-7f3c4e4fdf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:46.394700 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4566-e2cf-4a4c-afe2-7f3c4e4fdf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:46.394984 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4566-e2cf-4a4c-afe2-7f3c4e4fdf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:46.395261 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f4566-e2cf-4a4c-afe2-7f3c4e4fdf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:46.395907 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f4566-e2cf-4a4c-afe2-7f3c4e4fdf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:46.397557 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f4566-e2cf-4a4c-afe2-7f3c4e4fdf69 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:46.408638 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1454/2922] 10.222.0.26 () {58 vars in 1122 bytes} [Mon Oct 3 16:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 16:18:46.412778 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:46.424958 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eea042-28f9-4f76-aaec-ad9d6383fe12 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:46.429848 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:46.430530 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:46.430816 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:46.431094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] PATH_INFO: `/v3/projects/8d92a5119dbf4fcf9d6e61d290cef3e8/users/84b73b7e35cd4e4ea55b3c1304adad78/roles/722cda8b508d40678af249ff70cb0751` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:46.433094 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d92a5119dbf4fcf9d6e61d290cef3e8, user_id=84b73b7e35cd4e4ea55b3c1304adad78, role_id=722cda8b508d40678af249ff70cb0751)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:46.435894 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:46.448494 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1469/2923] 10.222.0.26 () {60 vars in 1483 bytes} [Mon Oct 3 16:18:46 2022] PUT /identity/v3/projects/8d92a5119dbf4fcf9d6e61d290cef3e8/users/84b73b7e35cd4e4ea55b3c1304adad78/roles/722cda8b508d40678af249ff70cb0751 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:18:51.941219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033b12-40ef-457a-beae-33f6422775b9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:51.941701 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033b12-40ef-457a-beae-33f6422775b9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:51.941868 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033b12-40ef-457a-beae-33f6422775b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:51.975933 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-73033b12-40ef-457a-beae-33f6422775b9 None None] MFA Rules not processed for user `84b73b7e35cd4e4ea55b3c1304adad78`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:51.977436 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-73033b12-40ef-457a-beae-33f6422775b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:52.057649 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1455/2924] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:18:52.074589 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:18:52.081418 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:52.213928 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1e70e-0db2-4fc3-9ca8-4127a2ef3547 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:18:52.220529 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:18:52.221153 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:52.221436 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:52.221722 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:52.270082 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:52.293725 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:18:52.295678 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:18:52.307475 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1470/2925] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:18:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:18:54.858779 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297388da-cf6a-4236-a349-e196aa5a8682 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:18:54.859331 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297388da-cf6a-4236-a349-e196aa5a8682 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:18:54.860018 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297388da-cf6a-4236-a349-e196aa5a8682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:18:54.868509 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:18:54.881320 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-297388da-cf6a-4236-a349-e196aa5a8682 None None] MFA Rules not processed for user `8d49e407b37744d384fafee7f0f9af60`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:18:54.882689 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-297388da-cf6a-4236-a349-e196aa5a8682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:18:54.889911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1456/2926] 10.222.0.26 () {58 vars in 958 bytes} [Mon Oct 3 16:18:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:19:02.329798 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:19:04.968114 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:19:22.628423 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:19:22.629885 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:19:22.685502 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc17b0-9f04-4407-ac18-5558bc08db2b service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:19:22.689031 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:19:22.689633 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:19:22.689943 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:19:22.690219 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:19:22.691865 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:19:22.706008 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:19:22.707444 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:19:22.719086 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1471/2927] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:19:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:19:22.859255 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297388da-cf6a-4236-a349-e196aa5a8682 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:19:22.869188 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297388da-cf6a-4236-a349-e196aa5a8682 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:19:22.872748 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:19:22.873344 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:19:22.873654 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:19:22.873966 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:19:22.882673 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:19:22.884097 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:19:22.893397 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1457/2928] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:19:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:19:32.714014 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=26 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:19:32.889217 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=6 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:20:40.676309 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:20:40.684912 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c11eb5-bd15-484d-8214-98463d6d9782 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:20:40.688485 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:20:40.689083 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:20:40.689384 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:20:40.689658 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:20:40.692050 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:20:40.701400 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:20:40.702842 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:20:40.711895 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1472/2929] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:20:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:20:50.707955 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:21:19.476563 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:21:19.486005 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabc4ec-3620-4d98-b5cb-da3178cda2de service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:21:19.490264 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87984df2-11bb-4447-9088-1bedca6a7159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:21:19.490866 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87984df2-11bb-4447-9088-1bedca6a7159 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:19.491215 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87984df2-11bb-4447-9088-1bedca6a7159 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:19.491492 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87984df2-11bb-4447-9088-1bedca6a7159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:19.493219 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-87984df2-11bb-4447-9088-1bedca6a7159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:21:19.508151 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87984df2-11bb-4447-9088-1bedca6a7159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:21:19.517712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87984df2-11bb-4447-9088-1bedca6a7159 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:21:19.522915 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1458/2930] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:21:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:21:29.516762 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=6 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:21:32.646891 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:21:32.655612 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61f372-943a-4c8d-baa6-cdcf8d9e15cb service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:21:32.659328 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e7f42-8d7f-499e-9371-89dc0cd38549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:21:32.659919 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e7f42-8d7f-499e-9371-89dc0cd38549 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:32.660713 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e7f42-8d7f-499e-9371-89dc0cd38549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:32.661009 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e7f42-8d7f-499e-9371-89dc0cd38549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:32.662776 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-588e7f42-8d7f-499e-9371-89dc0cd38549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:21:32.673618 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e7f42-8d7f-499e-9371-89dc0cd38549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:21:32.675244 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e7f42-8d7f-499e-9371-89dc0cd38549 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:21:32.685645 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1473/2931] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:21:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:21:33.118656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942921-3acc-42b5-9b34-009973997a29 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:33.120559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942921-3acc-42b5-9b34-009973997a29 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:33.120559 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b942921-3acc-42b5-9b34-009973997a29 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:33.120795 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1459/2932] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:21:33.126513 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be15a-2561-486d-8df5-b8f6389e510f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:33.126807 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be15a-2561-486d-8df5-b8f6389e510f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:33.127089 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be15a-2561-486d-8df5-b8f6389e510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:33.166701 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-734be15a-2561-486d-8df5-b8f6389e510f None None] MFA Rules not processed for user `bf531e7741af49f091e1116ec1c6751c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:21:33.167925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-734be15a-2561-486d-8df5-b8f6389e510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:21:33.174459 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1474/2933] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 16:21:33.188911 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b942921-3acc-42b5-9b34-009973997a29 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:21:33.200723 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b942921-3acc-42b5-9b34-009973997a29 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:21:33.204246 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ccc53-3eac-40e2-ab03-53e890af55f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:21:33.204835 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ccc53-3eac-40e2-ab03-53e890af55f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:33.205120 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ccc53-3eac-40e2-ab03-53e890af55f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:33.205395 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ccc53-3eac-40e2-ab03-53e890af55f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:33.212576 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ccc53-3eac-40e2-ab03-53e890af55f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:21:33.214042 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ccc53-3eac-40e2-ab03-53e890af55f2 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:21:33.221722 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1460/2934] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:21:33.304354 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fa1e7-7de3-4cdd-85ee-0491d1c94fb6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:33.304655 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fa1e7-7de3-4cdd-85ee-0491d1c94fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:33.304925 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fa1e7-7de3-4cdd-85ee-0491d1c94fb6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:33.306325 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1475/2935] 10.222.0.26 () {54 vars in 921 bytes} [Mon Oct 3 16:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 16:21:33.311300 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:33.311589 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:33.311869 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:33.355429 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] MFA Rules not processed for user `5550726a2c5e4aff9c16f509a3d1bb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 16:21:33.356656 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:21:33.366602 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1461/2936] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Oct 3 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 16:21:33.377105 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fa1e7-7de3-4cdd-85ee-0491d1c94fb6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:21:33.388210 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fa1e7-7de3-4cdd-85ee-0491d1c94fb6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:21:33.391813 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf531e7741af49f091e1116ec1c6751c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:21:33.392403 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:33.392684 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:33.392988 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:33.404283 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:21:33.405708 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:21:33.416860 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1476/2937] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:21:33.478983 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:21:33.480385 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:21:33.549956 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9dca2-cc1c-4992-bfaf-46c360cf5cc1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:21:33.555092 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:21:33.555712 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:33.555993 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:33.556263 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:33.558036 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:21:33.569254 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:21:33.570854 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:21:33.580548 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1462/2938] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:21:37.069084 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:21:37.080446 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd42e-215d-4f6f-8cd0-fb8722b8a156 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:21:37.087118 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:21:37.087709 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:21:37.087985 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:21:37.088258 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:21:37.090278 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:21:37.103274 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:21:37.104929 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:21:37.116327 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1477/2939] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:21:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:21:43.576413 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=47 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:21:47.111178 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=27 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:22:52.245823 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:22:52.247472 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:22:52.264527 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22f387-02f6-4358-a0a2-ea095959ff34 service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:22:52.270991 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5550726a2c5e4aff9c16f509a3d1bb0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:22:52.272365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:22:52.272365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:22:52.272365 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:22:52.273905 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:22:52.287201 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:22:52.288814 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:22:52.299971 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1463/2940] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:22:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:22:55.291587 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:22:55.303257 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21b577-f75b-499e-b5fd-d1a12fae9593 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:22:55.308837 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:22:55.309489 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:22:55.309793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:22:55.310069 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:22:55.311997 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:22:55.324467 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:22:55.326067 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:22:55.336484 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1478/2941] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:22:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:22:59.905133 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:22:59.905691 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:22:59.922642 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b4680-e761-4b28-85e9-0ab892947a81 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:22:59.927942 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:22:59.928561 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:22:59.928847 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:22:59.929123 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:22:59.931152 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:22:59.944432 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:22:59.946431 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:22:59.957969 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1464/2942] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:22:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:23:03.494259 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:23:03.505909 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9da7-cee2-4f1d-a46d-3951f9130610 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:23:03.511386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33f20c6985d48a0948969182d38ca08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afd4f59da7694f67a1a24afd4ed39eef', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:23:03.512795 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:23:03.513088 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:23:03.513526 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:23:03.515266 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:23:03.528362 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:23:03.529981 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:23:03.540419 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1479/2943] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Oct 3 16:23:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 16:23:03.630372 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:23:03.695426 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e9aca-d6d2-454a-a578-a6e7e3139fd4 service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:23:03.700319 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:23:03.700960 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:23:03.701225 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:23:03.701519 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] PATH_INFO: `/v3/users/8d49e407b37744d384fafee7f0f9af60` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:23:03.702696 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d49e407b37744d384fafee7f0f9af60)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:23:03.704646 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:23:03.883004 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d49e407b37744d384fafee7f0f9af60'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:03.883667 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d49e407b37744d384fafee7f0f9af60'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:03.952032 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d49e407b37744d384fafee7f0f9af60'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:03.959843 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d49e407b37744d384fafee7f0f9af60'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:03.972908 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d49e407b37744d384fafee7f0f9af60'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:03.979176 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1465/2944] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:23:03 2022] DELETE /identity/v3/users/8d49e407b37744d384fafee7f0f9af60 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:23:04.216685 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:23:04.229311 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553d447-b2ac-499e-a186-ddec7da786f8 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:23:04.295314 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:23:04.295939 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:23:04.296224 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:23:04.296500 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] PATH_INFO: `/v3/projects/dbbf4fc709c049038f29dfe59b3f01df` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:23:04.297631 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbf4fc709c049038f29dfe59b3f01df)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:23:04.299553 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:23:04.414561 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbf4fc709c049038f29dfe59b3f01df', 'request_id': 'req-ceda91be-2fcb-4338-87df-68f8ce29cd02'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.420608 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbf4fc709c049038f29dfe59b3f01df', 'request_id': 'req-ceda91be-2fcb-4338-87df-68f8ce29cd02'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.427115 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbf4fc709c049038f29dfe59b3f01df', 'request_id': 'req-ceda91be-2fcb-4338-87df-68f8ce29cd02'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.500000 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] The token cache is being invalidate because project dbbf4fc709c049038f29dfe59b3f01df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:23:04.500624 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.500996 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.502588 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1480/2945] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:23:04 2022] DELETE /identity/v3/projects/dbbf4fc709c049038f29dfe59b3f01df => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 16:23:04.506627 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:23:04.508039 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:23:04.521653 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1c15-2e11-4fee-8228-17cc99921ab9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:23:04.569651 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:23:04.578806 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:23:04.584136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:23:04.584136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:23:04.584136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] PATH_INFO: `/v3/users/84b73b7e35cd4e4ea55b3c1304adad78` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:23:04.584136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b73b7e35cd4e4ea55b3c1304adad78)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:23:04.584136 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:23:04.739574 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b73b7e35cd4e4ea55b3c1304adad78'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.740228 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b73b7e35cd4e4ea55b3c1304adad78'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.788274 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b73b7e35cd4e4ea55b3c1304adad78'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.795533 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b73b7e35cd4e4ea55b3c1304adad78'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.807448 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01c7f686-5262-4ac7-9bd3-b89f16450f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b73b7e35cd4e4ea55b3c1304adad78'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:04.813871 dv-cinder-844563-13-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1466/2946] 10.222.0.26 () {58 vars in 1224 bytes} [Mon Oct 3 16:23:04 2022] DELETE /identity/v3/users/84b73b7e35cd4e4ea55b3c1304adad78 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:23:05.024106 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 16:23:05.025793 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 16:23:05.039628 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda91be-2fcb-4338-87df-68f8ce29cd02 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 16:23:05.100044 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1309f51714bc425caa70be3d6c622b5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '070db3b7d7b04a4ba14f4a1d107620fd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 16:23:05.100681 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 16:23:05.100961 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 16:23:05.101234 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] PATH_INFO: `/v3/projects/8d92a5119dbf4fcf9d6e61d290cef3e8` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 16:23:05.102363 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d92a5119dbf4fcf9d6e61d290cef3e8)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 16:23:05.104564 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 16:23:05.111117 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:23:05.217191 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d92a5119dbf4fcf9d6e61d290cef3e8', 'request_id': 'req-de5bc470-f09b-4b8c-8b6e-6f927180324e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:05.223648 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d92a5119dbf4fcf9d6e61d290cef3e8', 'request_id': 'req-de5bc470-f09b-4b8c-8b6e-6f927180324e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:05.230216 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d92a5119dbf4fcf9d6e61d290cef3e8', 'request_id': 'req-de5bc470-f09b-4b8c-8b6e-6f927180324e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:05.317386 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] The token cache is being invalidate because project 8d92a5119dbf4fcf9d6e61d290cef3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 16:23:05.317592 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:05.318316 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-de5bc470-f09b-4b8c-8b6e-6f927180324e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 16:23:05.319862 dv-cinder-844563-13-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1481/2947] 10.222.0.26 () {58 vars in 1233 bytes} [Mon Oct 3 16:23:05 2022] DELETE /identity/v3/projects/8d92a5119dbf4fcf9d6e61d290cef3e8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 16:23:14.810388 dv-cinder-844563-13-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 16:23:15.528954 dv-cinder-844563-13-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}